[ 582.028822] env[71140]: INFO neutron.common.config [-] Logging enabled! [ 582.029300] env[71140]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 26.1.0.dev56 [ 582.029300] env[71140]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=71140) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 582.029561] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 582.029663] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 582.030483] env[71140]: WARNING oslo_policy.policy [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 582.030714] env[71140]: WARNING oslo_policy.policy [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 582.032192] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] VMware NSXv3 Agent initialized successfully. [ 582.032552] env[71140]: DEBUG oslo_concurrency.lockutils [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] Acquiring lock "singleton_lock" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.032694] env[71140]: DEBUG oslo_concurrency.lockutils [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] Acquired lock "singleton_lock" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.032922] env[71140]: DEBUG oslo_concurrency.lockutils [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] Releasing lock "singleton_lock" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.033232] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] Full set of CONF: {{(pid=71140) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 582.033448] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ******************************************************************************** {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 582.033572] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] Configuration options gathered from: {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 582.033808] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 582.034014] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 582.034148] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ================================================================================ {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 582.034334] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] agent_down_time = 75 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.034481] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] allow_automatic_dhcp_failover = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.034625] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] allow_bulk = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.034776] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] api_extensions_path = {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.034952] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] api_paste_config = api-paste.ini {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.035124] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] auth_strategy = keystone {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.035242] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] backdoor_port = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.035356] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] backdoor_socket = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.035504] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] backlog = 4096 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.035653] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] base_mac = fa:16:3e:00:00:00 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.035819] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] bind_host = 0.0.0.0 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.035976] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] bind_port = 9696 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.036130] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] client_socket_timeout = 900 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.036280] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] config_dir = [] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.036390] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.036537] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] config_source = [] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.036685] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] control_exchange = neutron {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.036834] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] core_plugin = ml2 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.036980] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] debug = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.037137] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] default_availability_zones = [] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.037352] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.037500] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] dhcp_agent_notification = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.037647] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] dhcp_agents_per_network = 1 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.037789] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] dhcp_lease_duration = 86400 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.037976] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] dhcp_load_type = networks {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.038189] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] dns_domain = openstacklocal {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.038348] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.038687] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] enable_default_route_bfd = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.038687] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] enable_default_route_ecmp = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.038782] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] enable_dvr = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.038910] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] enable_new_agents = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.039070] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] enable_services_on_agents_with_admin_state_down = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.039214] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] enable_signals = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.039356] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] enable_traditional_dhcp = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.039493] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] external_dns_driver = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.039631] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] filter_validation = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.039784] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] global_physnet_mtu = 8950 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.039931] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] graceful_shutdown_timeout = 60 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.040132] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] host = cpu-1 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.040287] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] host_dvr_for_dhcp = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.040433] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] http_retries = 3 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.040584] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] instance_format = [instance: %(uuid)s] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.040732] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.040880] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ipam_driver = internal {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.041035] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ipv6_pd_enabled = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.041181] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] l3_ha = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.041330] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.041476] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] l3_ha_network_physical_name = {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.041621] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] l3_ha_network_type = {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.041769] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] log_color = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.041912] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] log_config_append = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.042069] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.042214] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] log_dir = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.042353] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] log_file = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.042465] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] log_options = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.042656] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] log_rotate_interval = 1 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.042759] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] log_rotate_interval_type = days {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.042927] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] log_rotation_type = none {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.043056] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.043173] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.043323] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.043470] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.043583] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.043728] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] max_dns_nameservers = 5 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.043871] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] max_header_line = 16384 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.044054] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] max_l3_agents_per_router = 3 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.044228] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] max_logfile_count = 30 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.044373] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] max_logfile_size_mb = 200 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.044515] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] max_subnet_host_routes = 20 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.044667] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] my_ip = 10.180.1.21 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.044820] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] my_ipv6 = ::1 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.044984] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] network_auto_schedule = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.045138] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] network_link_prefix = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.045288] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.045438] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] notify_nova_on_port_data_changes = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.045585] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] notify_nova_on_port_status_changes = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.045734] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] pagination_max_limit = -1 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.045883] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] publish_errors = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.046085] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] rate_limit_burst = 0 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.046341] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] rate_limit_except_level = CRITICAL {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.046570] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] rate_limit_interval = 0 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.046816] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] retry_until_window = 30 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.047083] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] router_distributed = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.047345] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] rpc_resources_processing_step = 20 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051028] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] rpc_response_max_timeout = 600 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051028] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] rpc_response_timeout = 60 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051028] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] send_events_interval = 2 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051028] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] service_plugins = ['router'] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051028] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] setproctitle = on {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051028] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] shell_completion = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051028] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] state_path = /opt/stack/data/neutron {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051257] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] syslog_log_facility = LOG_USER {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051257] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] tcp_keepidle = 600 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051257] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] transport_url = **** {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051257] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] use_journal = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051257] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] use_json = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051257] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] use_ssl = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051257] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] use_stderr = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051427] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] use_syslog = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051427] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] vlan_qinq = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051427] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] vlan_transparent = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051427] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] watch_log_file = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051427] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] wsgi_default_pool_size = 100 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051427] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] wsgi_keep_alive = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051584] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051584] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] wsgi_server_debug = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 582.051584] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_concurrency.disable_process_locking = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.051584] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.051584] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.051584] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.051737] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.051737] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.051796] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.052086] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] profiler.connection_string = messaging:// {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.052086] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] profiler.enabled = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.052210] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] profiler.es_doc_type = notification {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.052356] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] profiler.es_scroll_size = 10000 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.052529] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] profiler.es_scroll_time = 2m {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.052861] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] profiler.filter_error_trace = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.052861] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] profiler.hmac_keys = **** {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.052982] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] profiler.sentinel_service_name = mymaster {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.053146] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] profiler.socket_timeout = 0.1 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.053289] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] profiler.trace_requests = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.053426] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] profiler.trace_sqlalchemy = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.053577] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] profiler_jaeger.process_tags = {} {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.053715] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] profiler_jaeger.service_name_prefix = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.053855] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] profiler_otlp.service_name_prefix = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.054019] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_policy.enforce_new_defaults = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.054289] env[71140]: WARNING oslo_config.cfg [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 582.054445] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_policy.enforce_scope = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.054595] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_policy.policy_default_rule = default {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.055357] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.055357] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.055357] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.055357] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.055357] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.055726] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.055726] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.055828] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_policy.remote_timeout = 60.0 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.055936] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.056106] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] agent.extensions = [] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.056303] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.056404] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] service_providers.service_provider = [] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.056553] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] QUOTAS.default_quota = -1 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.057683] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.057683] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] QUOTAS.quota_floatingip = 50 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.057683] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] QUOTAS.quota_network = 100 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.057683] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] QUOTAS.quota_port = 500 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.057683] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] QUOTAS.quota_rbac_policy = 10 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.057683] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] QUOTAS.quota_router = 10 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.058028] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] QUOTAS.quota_security_group = 10 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.058028] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] QUOTAS.quota_security_group_rule = 100 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.058123] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] QUOTAS.quota_subnet = 100 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.058224] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] QUOTAS.track_quota_usage = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.058385] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.058530] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep.group = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.058671] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep.helper_command = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.058820] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep.logger_name = oslo_privsep.daemon {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.058981] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep.thread_pool_size = 8 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.059120] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep.user = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.059280] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.059418] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_dhcp_release.group = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.059558] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_dhcp_release.helper_command = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.059702] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.059850] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.059993] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_dhcp_release.user = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.060158] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.060300] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_ovs_vsctl.group = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.060439] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_ovs_vsctl.helper_command = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.060584] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.060729] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.060869] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_ovs_vsctl.user = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.061026] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_namespace.capabilities = [21] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.061166] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_namespace.group = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.061305] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_namespace.helper_command = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.061448] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.061597] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_namespace.thread_pool_size = 8 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.061738] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_namespace.user = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.061888] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_conntrack.capabilities = [12] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.062039] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_conntrack.group = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.062181] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_conntrack.helper_command = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.062327] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.062472] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_conntrack.thread_pool_size = 8 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.062611] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_conntrack.user = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.062763] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_link.capabilities = [12, 21] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.062902] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_link.group = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.063055] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_link.helper_command = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.063203] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.063347] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_link.thread_pool_size = 8 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.063485] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] privsep_link.user = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.063646] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.063801] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.063946] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.continue_on_failed_promotions = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.064103] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.dscp = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.064248] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.dscp_inherit = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.064397] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.force_mp_to_policy = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.064536] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.locking_coordinator_url = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.064678] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.log_agent_heartbeats = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.064824] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.logging_expire = 1 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.065009] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.065170] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.065325] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.polling_interval = 240 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.065474] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.065626] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.quitting_rpc_timeout = 120 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.065776] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.report_interval = 30.0 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.065939] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.066103] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.066256] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.066403] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.sync_skew = 60 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.066548] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.synchronization_queue_size = 20 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.066696] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT.use_helper_for_ns_read = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.066847] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] SECURITYGROUP.enable_ipset = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.067015] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] SECURITYGROUP.enable_security_group = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.067164] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.067336] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.067503] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] experimental.ipv6_pd_enabled = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.067673] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ml2.extension_drivers = ['port_security'] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.067817] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ml2.external_network_type = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.067975] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.068143] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ml2.overlay_ip_version = 4 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.068298] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ml2.path_mtu = 8950 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.068446] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ml2.physical_network_mtus = {} {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.068599] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ml2.tenant_network_types = ['vlan'] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.068751] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.068903] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ml2.type_drivers = ['vlan'] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.069068] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT_CLI.neutron_port_id = [] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.069215] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.069363] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.069512] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.069667] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.069817] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.069966] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.070127] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.070275] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.070474] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.070628] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_login_password = **** {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.070782] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_login_port = 443 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.070931] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_login_user = admin {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.071094] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.071252] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.071400] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.071548] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.071698] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.071852] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.072012] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.072174] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.072322] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.072473] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.072626] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.072793] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.072954] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.073169] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.073327] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] vsphere.vsphere_login_password = VMware1! {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.073476] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.073623] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.073771] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] nova.auth_section = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.073924] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] nova.auth_type = password {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.074087] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.074231] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] nova.certfile = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.074374] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] nova.collect_timing = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.074524] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] nova.endpoint_type = public {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.074667] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] nova.insecure = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.074848] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] nova.keyfile = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.075014] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] nova.region_name = RegionOne {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.075168] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] nova.split_loggers = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.075315] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] nova.timeout = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.075462] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] placement.auth_section = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.075616] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] placement.auth_type = password {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.075765] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.075909] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] placement.certfile = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.076087] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] placement.collect_timing = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.076242] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] placement.endpoint_type = public {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.076385] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] placement.insecure = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.076524] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] placement.keyfile = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.076661] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] placement.region_name = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.076800] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] placement.split_loggers = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.076941] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] placement.timeout = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.077105] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.auth_section = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.077250] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.auth_type = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.077392] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.cafile = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.077532] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.certfile = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.077678] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.collect_timing = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.077822] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.connect_retries = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.078015] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.connect_retry_delay = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.078182] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.enable_notifications = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.078324] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.endpoint_override = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.078470] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.insecure = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.078610] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.interface = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.078751] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.keyfile = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.078891] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.max_version = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.079047] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.min_version = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.079189] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.region_name = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.079329] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.retriable_status_codes = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.079469] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.service_name = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.079610] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.service_type = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.079759] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.split_loggers = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.079903] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.status_code_retries = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.080086] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.status_code_retry_delay = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.080244] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.timeout = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.080391] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.valid_interfaces = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.080533] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ironic.version = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.080685] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] cli_script.dry_run = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.080841] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.080989] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.081151] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.081295] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.081437] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.081579] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.081721] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.081864] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.082015] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.082174] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.082315] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.082463] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.082610] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.082778] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.082936] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.083101] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.083247] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.083391] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.083541] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.083688] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.083832] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.083981] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.084141] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.084284] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.084427] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.084569] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.084778] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.084966] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.085198] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.085488] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.085721] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.ssl = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.085901] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.086072] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.086223] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.086373] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.086522] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.ssl_version = {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.086666] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.086844] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_notifications.driver = [] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.087023] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_notifications.retry = -1 {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.087193] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.087340] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] oslo_messaging_notifications.transport_url = **** {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 582.087458] env[71140]: DEBUG oslo_service.backend.eventlet.service [None req-e92a0621-ae26-4aa6-94dd-a16837dbee3c None None] ******************************************************************************** {{(pid=71140) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 582.088443] env[71140]: DEBUG neutron.agent.securitygroups_rpc [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Init firewall settings (driver=nsxv3) {{(pid=71140) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 582.089729] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=71140) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 582.089974] env[71140]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] RPC agent_id: nsxm-l-01a.corp.local [ 582.092274] env[71140]: DEBUG dogpile.cache.region [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 582.092461] env[71140]: DEBUG dogpile.lock [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 582.092610] env[71140]: DEBUG dogpile.lock [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 582.092718] env[71140]: DEBUG dogpile.lock [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 582.092882] env[71140]: DEBUG dogpile.cache.region [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 582.092983] env[71140]: DEBUG dogpile.lock [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 582.093166] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 582.112232] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Session token - acquiring [ 582.112306] env[71140]: DEBUG networking_nsxv3.common.locking [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.112306] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.112306] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.112446] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.122452] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.390951] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 582.411199] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 582.411433] env[71140]: DEBUG dogpile.cache.region [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Cache value generated in 0.318 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 582.411511] env[71140]: DEBUG dogpile.lock [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 582.411587] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Activating Policy API Provider. [ 582.411783] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Looking for the default Infrastructure Rules. [ 582.468731] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Looking for the Default Layer3 Logged Drop Section. [ 582.480409] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 582.480852] env[71140]: DEBUG networking_nsxv3.common.locking [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.481035] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquiring lock "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.481145] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired lock "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.481412] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired external semaphore "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.481744] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.995979] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.498711] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.001615] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Inventory metadata is going to be refreshed. [ 584.001869] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 584.701871] env[71140]: DEBUG networking_nsxv3.common.locking [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.702392] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.702392] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.702545] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.714467] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 584.814550] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.815508] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 584.832693] env[71140]: DEBUG networking_nsxv3.common.locking [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.832932] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.832995] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.833290] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.833419] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.833567] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 584.833684] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 584.833791] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 584.852112] env[71140]: DEBUG networking_nsxv3.common.locking [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.852325] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.852409] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.852680] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.852881] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.853050] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 584.870011] env[71140]: DEBUG networking_nsxv3.common.locking [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.870197] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.870305] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.870552] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.870689] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.870823] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 584.887761] env[71140]: DEBUG networking_nsxv3.common.locking [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.887955] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquiring lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.888039] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.888278] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired external semaphore "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.888413] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Releasing lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.888554] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 584.888663] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 584.888768] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 584.905774] env[71140]: DEBUG networking_nsxv3.common.locking [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.905989] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquiring lock "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.906065] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired lock "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.906316] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired external semaphore "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.906436] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Releasing lock "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.906571] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 584.906674] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 584.906780] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 584.924744] env[71140]: DEBUG networking_nsxv3.common.locking [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.924965] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.925043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.925293] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.925441] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.925591] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 584.925700] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 584.925801] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Inventory metadata have been refreshed. [ 584.925918] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Dryrun:True. Metadata refresh completed. [ 584.926055] env[71140]: DEBUG oslo_concurrency.lockutils [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Releasing lock "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.927704] env[71140]: INFO neutron.agent.agent_extensions_manager [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Loaded agent extensions: [] [ 584.928466] env[71140]: DEBUG neutron_lib.callbacks.manager [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=71140) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 584.977975] env[71140]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] NSXv3 Agent Agent RPC Daemon Started! [ 584.978123] env[71140]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] NSXv3 Agent Agent loop - iteration:0 started [ 584.978170] env[71140]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] NSXv3 Agent Agent out of sync with plugin! [ 589.929377] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 589.929766] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 594.930637] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 594.930985] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 598.956389] env[71140]: INFO networking_nsxv3.common.synchronization [None req-f4736dab-88b3-43a0-b0f8-74fa4f2bc8b2 demo admin] Enqueued Resource ID: 3f5a2e08-3ead-4b92-bdb8-1fed9b4d8fd0 with Priority: HIGHEST for action security_group_rules [ 598.957243] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f5a2e08-3ead-4b92-bdb8-1fed9b4d8fd0 with Priority: HIGHEST for action security_group_rules [ 598.957645] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f5a2e08-3ead-4b92-bdb8-1fed9b4d8fd0 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.957934] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f5a2e08-3ead-4b92-bdb8-1fed9b4d8fd0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.958181] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f5a2e08-3ead-4b92-bdb8-1fed9b4d8fd0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.958931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f5a2e08-3ead-4b92-bdb8-1fed9b4d8fd0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.958931] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f5a2e08-3ead-4b92-bdb8-1fed9b4d8fd0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.477589] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.477781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.477820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.478009] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.478107] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.478203] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f5a2e08-3ead-4b92-bdb8-1fed9b4d8fd0 already deleted. [ 599.478286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f5a2e08-3ead-4b92-bdb8-1fed9b4d8fd0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.959025] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 603.959426] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 608.960853] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 608.963455] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 613.962393] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 613.962393] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 618.965421] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 618.968159] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 623.967588] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 623.967588] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 624.671165] env[71140]: INFO networking_nsxv3.common.synchronization [None req-3a3d5a78-5a0a-4363-b1e0-194a0926637b None None] Enqueued Resource ID: 33437107-a359-4dcd-b575-c0b402811921 with Priority: HIGHEST for action port [ 624.671165] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33437107-a359-4dcd-b575-c0b402811921 with Priority: HIGHEST for action port [ 624.671407] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-33437107-a359-4dcd-b575-c0b402811921 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.671507] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33437107-a359-4dcd-b575-c0b402811921" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.671702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33437107-a359-4dcd-b575-c0b402811921" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.671818] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33437107-a359-4dcd-b575-c0b402811921" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.671900] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33437107-a359-4dcd-b575-c0b402811921',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.715841] env[71140]: INFO networking_nsxv3.common.synchronization [None req-823d088e-661c-4f20-850f-a92f66b6faf2 None None] Enqueued Resource ID: 1aa34b0a-c73b-4bde-9ae7-17636340a7e1 with Priority: HIGHEST for action port [ 624.717186] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aa34b0a-c73b-4bde-9ae7-17636340a7e1 with Priority: HIGHEST for action port [ 624.717631] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-1aa34b0a-c73b-4bde-9ae7-17636340a7e1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.718107] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1aa34b0a-c73b-4bde-9ae7-17636340a7e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.718321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1aa34b0a-c73b-4bde-9ae7-17636340a7e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.719757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1aa34b0a-c73b-4bde-9ae7-17636340a7e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.719757] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aa34b0a-c73b-4bde-9ae7-17636340a7e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.175357] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33437107-a359-4dcd-b575-c0b402811921 [ 625.176679] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.176679] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.176679] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.176679] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.176915] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.176915] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33437107-a359-4dcd-b575-c0b402811921 already deleted. [ 625.176915] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33437107-a359-4dcd-b575-c0b402811921" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.221473] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1aa34b0a-c73b-4bde-9ae7-17636340a7e1 [ 625.221699] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.221834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.221935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.222124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.222211] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.222323] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1aa34b0a-c73b-4bde-9ae7-17636340a7e1 already deleted. [ 625.222384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1aa34b0a-c73b-4bde-9ae7-17636340a7e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.447926] env[71140]: INFO networking_nsxv3.common.synchronization [None req-b5ad23be-553c-41be-9e06-ae8b6de27cc9 None None] Enqueued Resource ID: e35bcd9f-abdf-475d-bcb4-60a96c077ec8 with Priority: HIGHEST for action port [ 625.448201] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e35bcd9f-abdf-475d-bcb4-60a96c077ec8 with Priority: HIGHEST for action port [ 625.448755] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-e35bcd9f-abdf-475d-bcb4-60a96c077ec8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.448886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e35bcd9f-abdf-475d-bcb4-60a96c077ec8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.448983] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e35bcd9f-abdf-475d-bcb4-60a96c077ec8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.449209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e35bcd9f-abdf-475d-bcb4-60a96c077ec8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.449293] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e35bcd9f-abdf-475d-bcb4-60a96c077ec8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.952978] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e35bcd9f-abdf-475d-bcb4-60a96c077ec8 [ 625.952978] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.952978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.953124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.953304] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.953375] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.953457] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e35bcd9f-abdf-475d-bcb4-60a96c077ec8 already deleted. [ 625.953537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e35bcd9f-abdf-475d-bcb4-60a96c077ec8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.935141] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.935141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.935141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.935141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.935141] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.936486] env[71140]: INFO networking_nsxv3.common.synchronization [None req-de518128-628c-47e3-86a5-94751412aa9d None None] Enqueued Resource ID: bfe2964f-3882-457f-b8e7-93b221049457 with Priority: HIGHEST for action port [ 626.938147] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfe2964f-3882-457f-b8e7-93b221049457 with Priority: HIGHEST for action port [ 626.939903] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfe2964f-3882-457f-b8e7-93b221049457 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.939903] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfe2964f-3882-457f-b8e7-93b221049457" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.939903] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfe2964f-3882-457f-b8e7-93b221049457" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.939903] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfe2964f-3882-457f-b8e7-93b221049457" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.939903] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfe2964f-3882-457f-b8e7-93b221049457',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.974221] env[71140]: INFO networking_nsxv3.common.synchronization [None req-14b164ad-2736-40c3-8e3e-855e4ba73077 None None] Enqueued Resource ID: f096558b-b9bb-4877-912e-1f4852f72649 with Priority: HIGHEST for action port [ 626.974570] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f096558b-b9bb-4877-912e-1f4852f72649 with Priority: HIGHEST for action port [ 626.974962] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-f096558b-b9bb-4877-912e-1f4852f72649 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.975064] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f096558b-b9bb-4877-912e-1f4852f72649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.975064] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f096558b-b9bb-4877-912e-1f4852f72649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.975575] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f096558b-b9bb-4877-912e-1f4852f72649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.975701] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f096558b-b9bb-4877-912e-1f4852f72649',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.422426] env[71140]: INFO networking_nsxv3.common.synchronization [None req-081735a9-f051-4aa7-8feb-6bc101036650 None None] Enqueued Resource ID: 4cdcf743-2130-4bb2-a220-e7eb11ee301b with Priority: HIGHEST for action port [ 627.422545] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cdcf743-2130-4bb2-a220-e7eb11ee301b with Priority: HIGHEST for action port [ 627.422836] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cdcf743-2130-4bb2-a220-e7eb11ee301b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.422950] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cdcf743-2130-4bb2-a220-e7eb11ee301b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.426127] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cdcf743-2130-4bb2-a220-e7eb11ee301b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.426127] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cdcf743-2130-4bb2-a220-e7eb11ee301b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.426127] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cdcf743-2130-4bb2-a220-e7eb11ee301b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.438074] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.442021] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bfe2964f-3882-457f-b8e7-93b221049457 [ 627.443095] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.443095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.443095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.443095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.443095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.443095] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bfe2964f-3882-457f-b8e7-93b221049457 already deleted. [ 627.443326] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfe2964f-3882-457f-b8e7-93b221049457" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.479890] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f096558b-b9bb-4877-912e-1f4852f72649 [ 627.479981] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.480347] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.480347] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.480516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.480924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.481370] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f096558b-b9bb-4877-912e-1f4852f72649 already deleted. [ 627.481370] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f096558b-b9bb-4877-912e-1f4852f72649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.929338] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4cdcf743-2130-4bb2-a220-e7eb11ee301b [ 627.929576] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.930109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.930109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.930109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.930109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.930284] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4cdcf743-2130-4bb2-a220-e7eb11ee301b already deleted. [ 627.930284] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cdcf743-2130-4bb2-a220-e7eb11ee301b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.941863] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.970614] env[71140]: INFO networking_nsxv3.common.synchronization [None req-a5590cf3-32b2-496d-8e86-e72268653250 None None] Enqueued Resource ID: 8b5c704e-2c8d-48cb-9975-001be99d1289 with Priority: HIGHEST for action port [ 627.972036] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b5c704e-2c8d-48cb-9975-001be99d1289 with Priority: HIGHEST for action port [ 627.972558] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b5c704e-2c8d-48cb-9975-001be99d1289 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.973332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b5c704e-2c8d-48cb-9975-001be99d1289" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.973754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b5c704e-2c8d-48cb-9975-001be99d1289" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.974134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b5c704e-2c8d-48cb-9975-001be99d1289" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.974285] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b5c704e-2c8d-48cb-9975-001be99d1289',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.448954] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 628.448954] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 628.477042] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b5c704e-2c8d-48cb-9975-001be99d1289 [ 628.477136] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.477409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.477409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.477727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.477727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.477727] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b5c704e-2c8d-48cb-9975-001be99d1289 already deleted. [ 628.478622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b5c704e-2c8d-48cb-9975-001be99d1289" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.157485] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.157485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.157485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.157485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.171357] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 629.172307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.176768] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 629.191781] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.191781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.191781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.191781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.191781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.191781] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 629.191781] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 629.191781] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 629.211018] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.211520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.211520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.211520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.211686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.211715] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 629.235620] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.235620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.235620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.235811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.235843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.235964] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 629.257879] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.257879] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.257879] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.257879] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.257879] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.257879] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 629.257879] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 629.257879] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 629.273625] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.273754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.273794] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.275614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.275614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.275614] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 629.275614] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 629.275614] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 629.295717] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.295852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.295923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.296152] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.296355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.296411] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 629.296447] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 629.296716] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 629.296716] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 629.296716] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 629.296716] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 629.296922] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 629.297099] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 629.297190] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 629.297303] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 629.317337] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.317567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.317693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.317800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.317957] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.318077] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 629.335136] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.335136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.335136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.335335] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.335447] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.366788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.385412] env[71140]: INFO networking_nsxv3.common.synchronization [None req-2e300acb-c709-4cc6-9047-09fbd16d32ce None None] Enqueued Resource ID: b1f7ee8c-37c9-4fd2-ad11-69337598d90a with Priority: HIGHEST for action port [ 629.385984] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1f7ee8c-37c9-4fd2-ad11-69337598d90a with Priority: HIGHEST for action port [ 629.386234] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1f7ee8c-37c9-4fd2-ad11-69337598d90a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.386350] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1f7ee8c-37c9-4fd2-ad11-69337598d90a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.386415] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1f7ee8c-37c9-4fd2-ad11-69337598d90a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.386976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1f7ee8c-37c9-4fd2-ad11-69337598d90a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.386976] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f7ee8c-37c9-4fd2-ad11-69337598d90a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.891964] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1f7ee8c-37c9-4fd2-ad11-69337598d90a [ 629.892931] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.893113] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.893189] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.893461] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.893566] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.893672] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1f7ee8c-37c9-4fd2-ad11-69337598d90a already deleted. [ 629.893756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1f7ee8c-37c9-4fd2-ad11-69337598d90a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.041146] env[71140]: INFO networking_nsxv3.common.synchronization [None req-43abc220-a8a2-4617-a9e7-f6c78e97ad39 None None] Enqueued Resource ID: b259043f-5c29-4362-8bc9-cca143a16b66 with Priority: HIGHEST for action port [ 630.041310] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b259043f-5c29-4362-8bc9-cca143a16b66 with Priority: HIGHEST for action port [ 630.041994] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-b259043f-5c29-4362-8bc9-cca143a16b66 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.041994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b259043f-5c29-4362-8bc9-cca143a16b66" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.042103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b259043f-5c29-4362-8bc9-cca143a16b66" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.042462] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b259043f-5c29-4362-8bc9-cca143a16b66" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.042462] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b259043f-5c29-4362-8bc9-cca143a16b66',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.407188] env[71140]: INFO networking_nsxv3.common.synchronization [None req-8994656d-f8f3-4beb-b7b8-894029777406 None None] Enqueued Resource ID: d0f45a2d-9a9f-40f3-947f-0a24a5921eb9 with Priority: HIGHEST for action port [ 630.407188] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0f45a2d-9a9f-40f3-947f-0a24a5921eb9 with Priority: HIGHEST for action port [ 630.408859] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0f45a2d-9a9f-40f3-947f-0a24a5921eb9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.408990] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0f45a2d-9a9f-40f3-947f-0a24a5921eb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.409176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0f45a2d-9a9f-40f3-947f-0a24a5921eb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.409475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0f45a2d-9a9f-40f3-947f-0a24a5921eb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.410522] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0f45a2d-9a9f-40f3-947f-0a24a5921eb9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.544303] env[71140]: INFO networking_nsxv3.common.synchronization [None req-d9bee68b-43ee-421a-b5e7-e8d357ded4c0 None None] Enqueued Resource ID: 88d5fc30-03b4-4aaa-ab95-dfa49a90c415 with Priority: HIGHEST for action port [ 630.547586] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b259043f-5c29-4362-8bc9-cca143a16b66 [ 630.547586] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.547586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.547586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.547586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.547586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.547586] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b259043f-5c29-4362-8bc9-cca143a16b66 already deleted. [ 630.547586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b259043f-5c29-4362-8bc9-cca143a16b66" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.547586] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88d5fc30-03b4-4aaa-ab95-dfa49a90c415 with Priority: HIGHEST for action port [ 630.548226] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-88d5fc30-03b4-4aaa-ab95-dfa49a90c415 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.548333] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88d5fc30-03b4-4aaa-ab95-dfa49a90c415" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.548398] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88d5fc30-03b4-4aaa-ab95-dfa49a90c415" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.548662] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88d5fc30-03b4-4aaa-ab95-dfa49a90c415" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.548782] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88d5fc30-03b4-4aaa-ab95-dfa49a90c415',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.913099] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0f45a2d-9a9f-40f3-947f-0a24a5921eb9 [ 630.913372] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.913453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.913545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.913777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.913858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.913958] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0f45a2d-9a9f-40f3-947f-0a24a5921eb9 already deleted. [ 630.914055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0f45a2d-9a9f-40f3-947f-0a24a5921eb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.052409] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88d5fc30-03b4-4aaa-ab95-dfa49a90c415 [ 631.052409] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.052409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.052409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.052409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.052409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.052694] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88d5fc30-03b4-4aaa-ab95-dfa49a90c415 already deleted. [ 631.052694] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88d5fc30-03b4-4aaa-ab95-dfa49a90c415" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.776753] env[71140]: INFO networking_nsxv3.common.synchronization [None req-c30109cf-8dbe-43f2-921b-2fda56cec3f9 None None] Enqueued Resource ID: c07a5c1c-8767-4bc0-ab40-c79067a65796 with Priority: HIGHEST for action port [ 632.778091] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c07a5c1c-8767-4bc0-ab40-c79067a65796 with Priority: HIGHEST for action port [ 632.782221] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-c07a5c1c-8767-4bc0-ab40-c79067a65796 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.782221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c07a5c1c-8767-4bc0-ab40-c79067a65796" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.782221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c07a5c1c-8767-4bc0-ab40-c79067a65796" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.782221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c07a5c1c-8767-4bc0-ab40-c79067a65796" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.782221] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c07a5c1c-8767-4bc0-ab40-c79067a65796',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.009103] env[71140]: INFO networking_nsxv3.common.synchronization [None req-2fab2e94-1e77-4c6e-b5ff-841b9a98a494 None None] Enqueued Resource ID: d47683e3-05a2-4751-9f0e-1b7b14bd9833 with Priority: HIGHEST for action port [ 633.011018] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47683e3-05a2-4751-9f0e-1b7b14bd9833 with Priority: HIGHEST for action port [ 633.011018] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-d47683e3-05a2-4751-9f0e-1b7b14bd9833 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.011018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d47683e3-05a2-4751-9f0e-1b7b14bd9833" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.011018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d47683e3-05a2-4751-9f0e-1b7b14bd9833" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.011592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d47683e3-05a2-4751-9f0e-1b7b14bd9833" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.011858] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d47683e3-05a2-4751-9f0e-1b7b14bd9833',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.033176] env[71140]: INFO networking_nsxv3.common.synchronization [None req-e0f4f635-9fac-4ac1-b856-fab9ddf83d51 None None] Enqueued Resource ID: 914246fe-8667-4fe3-8dfe-8b8d29db32c3 with Priority: HIGHEST for action port [ 633.033176] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 914246fe-8667-4fe3-8dfe-8b8d29db32c3 with Priority: HIGHEST for action port [ 633.033176] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-914246fe-8667-4fe3-8dfe-8b8d29db32c3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.033176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-914246fe-8667-4fe3-8dfe-8b8d29db32c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.033176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-914246fe-8667-4fe3-8dfe-8b8d29db32c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.033176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-914246fe-8667-4fe3-8dfe-8b8d29db32c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.033176] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('914246fe-8667-4fe3-8dfe-8b8d29db32c3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.282190] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c07a5c1c-8767-4bc0-ab40-c79067a65796 [ 633.282865] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.283106] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.283552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.283887] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.283887] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.283988] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c07a5c1c-8767-4bc0-ab40-c79067a65796 already deleted. [ 633.284099] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c07a5c1c-8767-4bc0-ab40-c79067a65796" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.515631] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d47683e3-05a2-4751-9f0e-1b7b14bd9833 [ 633.515939] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.516125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.516217] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.516499] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.516660] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.523607] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d47683e3-05a2-4751-9f0e-1b7b14bd9833 already deleted. [ 633.523607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d47683e3-05a2-4751-9f0e-1b7b14bd9833" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.538905] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 914246fe-8667-4fe3-8dfe-8b8d29db32c3 [ 633.539099] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.539194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.539264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.539487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.539738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.539738] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:914246fe-8667-4fe3-8dfe-8b8d29db32c3 already deleted. [ 633.539806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-914246fe-8667-4fe3-8dfe-8b8d29db32c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.586333] env[71140]: INFO networking_nsxv3.common.synchronization [None req-1942c480-f7f3-4350-9e06-85d57eff49c3 tempest-ServersTestBootFromVolume-320963912 tempest-ServersTestBootFromVolume-320963912-project-member] Enqueued Resource ID: 1b5a6141-3574-468b-87ed-785459f7a84a with Priority: HIGHEST for action security_group_rules [ 633.586333] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5a6141-3574-468b-87ed-785459f7a84a with Priority: HIGHEST for action security_group_rules [ 633.586333] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b5a6141-3574-468b-87ed-785459f7a84a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.586333] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.586333] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.586534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.586534] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b5a6141-3574-468b-87ed-785459f7a84a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.716646] env[71140]: INFO networking_nsxv3.common.synchronization [None req-9dd7e2af-74a8-43c3-bd10-b0dc8f4eb770 None None] Enqueued Resource ID: 13d76d93-a26c-4bbc-abee-778dc9d5b9f4 with Priority: HIGHEST for action port [ 633.718105] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d76d93-a26c-4bbc-abee-778dc9d5b9f4 with Priority: HIGHEST for action port [ 633.719206] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-13d76d93-a26c-4bbc-abee-778dc9d5b9f4 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.719443] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13d76d93-a26c-4bbc-abee-778dc9d5b9f4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.720993] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13d76d93-a26c-4bbc-abee-778dc9d5b9f4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.720993] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13d76d93-a26c-4bbc-abee-778dc9d5b9f4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.720993] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13d76d93-a26c-4bbc-abee-778dc9d5b9f4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.986916] env[71140]: INFO networking_nsxv3.common.synchronization [None req-434ee2c9-cd86-4b0c-b8d3-9e4a5c58e3b1 tempest-ServersTestBootFromVolume-320963912 tempest-ServersTestBootFromVolume-320963912-project-member] Enqueued Resource ID: 1b5a6141-3574-468b-87ed-785459f7a84a with Priority: HIGHEST for action security_group_rules [ 633.988013] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5a6141-3574-468b-87ed-785459f7a84a with Priority: HIGHEST for action security_group_rules [ 633.988587] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b5a6141-3574-468b-87ed-785459f7a84a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.988757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.108781] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.108958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.109073] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.109261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.109354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.109452] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b5a6141-3574-468b-87ed-785459f7a84a already deleted. [ 634.109579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.109681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.109836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.109923] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b5a6141-3574-468b-87ed-785459f7a84a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.226405] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13d76d93-a26c-4bbc-abee-778dc9d5b9f4 [ 634.226405] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.226405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.226405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.226405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.226405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.226405] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13d76d93-a26c-4bbc-abee-778dc9d5b9f4 already deleted. [ 634.226679] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13d76d93-a26c-4bbc-abee-778dc9d5b9f4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.488058] env[71140]: INFO networking_nsxv3.common.synchronization [None req-0241ef11-0489-44eb-8076-4a1109b5f575 None None] Enqueued Resource ID: d063e174-8a1c-4146-8f7e-abb244053f24 with Priority: HIGHEST for action port [ 634.488058] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d063e174-8a1c-4146-8f7e-abb244053f24 with Priority: HIGHEST for action port [ 634.488729] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-d063e174-8a1c-4146-8f7e-abb244053f24 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.488729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d063e174-8a1c-4146-8f7e-abb244053f24" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.488729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d063e174-8a1c-4146-8f7e-abb244053f24" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.488905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d063e174-8a1c-4146-8f7e-abb244053f24" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.488979] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d063e174-8a1c-4146-8f7e-abb244053f24',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.577849] env[71140]: INFO networking_nsxv3.common.synchronization [req-bb4c2d69-fb8b-4e5d-884e-475dda2df5d0 req-d3063c3f-cf6c-4bb9-85f7-fa4ceff5809f tempest-SecurityGroupRulesNegativeTestJSON-1476014075 tempest-SecurityGroupRulesNegativeTestJSON-1476014075-project-member] Enqueued Resource ID: 78eff523-917e-40d5-a827-718710a49d67 with Priority: HIGHEST for action security_group_rules [ 634.578427] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78eff523-917e-40d5-a827-718710a49d67 with Priority: HIGHEST for action security_group_rules [ 634.578751] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78eff523-917e-40d5-a827-718710a49d67 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.578893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78eff523-917e-40d5-a827-718710a49d67" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.578963] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78eff523-917e-40d5-a827-718710a49d67" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.579234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78eff523-917e-40d5-a827-718710a49d67" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.579321] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78eff523-917e-40d5-a827-718710a49d67',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.631060] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.631060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.631167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.631379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.631490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.631602] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b5a6141-3574-468b-87ed-785459f7a84a already deleted. [ 634.631692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.991585] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d063e174-8a1c-4146-8f7e-abb244053f24 [ 634.992073] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.992073] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.992073] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.992653] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.992878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.992878] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d063e174-8a1c-4146-8f7e-abb244053f24 already deleted. [ 634.992975] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d063e174-8a1c-4146-8f7e-abb244053f24" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.102442] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.102442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.102442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.102584] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.102584] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.102690] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78eff523-917e-40d5-a827-718710a49d67 already deleted. [ 635.102767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78eff523-917e-40d5-a827-718710a49d67" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.634320] env[71140]: INFO networking_nsxv3.common.synchronization [None req-e43d7389-d559-4dbe-9c91-6095f8abd4eb None None] Enqueued Resource ID: 948e8697-7d50-4785-8ad9-b9a31f9bbbc5 with Priority: HIGHEST for action port [ 635.634475] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 948e8697-7d50-4785-8ad9-b9a31f9bbbc5 with Priority: HIGHEST for action port [ 635.635085] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-948e8697-7d50-4785-8ad9-b9a31f9bbbc5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.635427] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-948e8697-7d50-4785-8ad9-b9a31f9bbbc5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.635427] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-948e8697-7d50-4785-8ad9-b9a31f9bbbc5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.635649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-948e8697-7d50-4785-8ad9-b9a31f9bbbc5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.635801] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('948e8697-7d50-4785-8ad9-b9a31f9bbbc5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.733505] env[71140]: INFO networking_nsxv3.common.synchronization [req-986fc4eb-d7cb-44e6-894a-bdcfc7121e29 req-d187e8e5-f7a3-494b-a983-85ec14445aa4 tempest-ServerDiagnosticsNegativeTest-1873623418 tempest-ServerDiagnosticsNegativeTest-1873623418-project-member] Enqueued Resource ID: 54bba0b8-b95d-4902-8afe-f2600efb516b with Priority: HIGHEST for action security_group_members [ 635.734032] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54bba0b8-b95d-4902-8afe-f2600efb516b with Priority: HIGHEST for action security_group_members [ 635.734419] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-54bba0b8-b95d-4902-8afe-f2600efb516b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.734517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.734517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.734812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.734909] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.735108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.735990] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.735990] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.735990] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.736095] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54bba0b8-b95d-4902-8afe-f2600efb516b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.140016] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 948e8697-7d50-4785-8ad9-b9a31f9bbbc5 [ 636.140314] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.140314] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.140314] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.143382] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.143382] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.143382] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:948e8697-7d50-4785-8ad9-b9a31f9bbbc5 already deleted. [ 636.143382] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-948e8697-7d50-4785-8ad9-b9a31f9bbbc5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.240635] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.240635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.240635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.240635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.240635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.240635] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.240635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.240635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.240635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.240635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.240635] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54bba0b8-b95d-4902-8afe-f2600efb516b already deleted. [ 636.240635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.077278] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.077278] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.077508] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.077728] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.077895] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.078074] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.078242] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.078468] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.078810] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.078914] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 637.079045] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 637.079155] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 637.079271] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 637.079382] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 637.079510] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 637.079630] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 637.092700] env[71140]: INFO networking_nsxv3.common.synchronization [None req-ac68cdbe-ff2a-44dc-8487-940a1c0b4124 None None] Enqueued Resource ID: b3fa04ed-1653-48f3-b1e6-aa25cc862a00 with Priority: HIGHEST for action port [ 637.092700] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3fa04ed-1653-48f3-b1e6-aa25cc862a00 with Priority: HIGHEST for action port [ 637.092700] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3fa04ed-1653-48f3-b1e6-aa25cc862a00 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.092914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3fa04ed-1653-48f3-b1e6-aa25cc862a00" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.092914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3fa04ed-1653-48f3-b1e6-aa25cc862a00" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.093170] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3fa04ed-1653-48f3-b1e6-aa25cc862a00" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.093276] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3fa04ed-1653-48f3-b1e6-aa25cc862a00',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.098215] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 637.098408] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 637.098561] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 637.098758] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.100759] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-c1f52d7f-aaf7-446d-9a45-8c273a99a5f4 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.100759] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-c1f52d7f-aaf7-446d-9a45-8c273a99a5f4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.100759] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-c1f52d7f-aaf7-446d-9a45-8c273a99a5f4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.100759] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-c1f52d7f-aaf7-446d-9a45-8c273a99a5f4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.100759] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1f52d7f-aaf7-446d-9a45-8c273a99a5f4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.598832] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3fa04ed-1653-48f3-b1e6-aa25cc862a00 [ 637.598832] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.598832] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.598832] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.598832] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.598832] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.598832] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3fa04ed-1653-48f3-b1e6-aa25cc862a00 already deleted. [ 637.598832] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3fa04ed-1653-48f3-b1e6-aa25cc862a00" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.605964] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.606728] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.609317] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.609317] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.609317] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.609317] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port c1f52d7f-aaf7-446d-9a45-8c273a99a5f4 not found, creating... [ 637.609317] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.609317] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.609317] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.609317] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.609317] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.609609] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.611122] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.611728] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.612136] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.612398] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.612654] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: c1f52d7f-aaf7-446d-9a45-8c273a99a5f4 is going to be created. [ 637.633104] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.633388] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.633525] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.634352] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.634352] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.634352] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-c1f52d7f-aaf7-446d-9a45-8c273a99a5f4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.786016] env[71140]: INFO networking_nsxv3.common.synchronization [req-986fc4eb-d7cb-44e6-894a-bdcfc7121e29 req-acbc1643-3a5a-4d8d-9fe5-e3a818cb6d38 service nova] Enqueued Resource ID: 54bba0b8-b95d-4902-8afe-f2600efb516b with Priority: HIGHEST for action security_group_rules [ 638.786016] env[71140]: INFO networking_nsxv3.common.synchronization [req-986fc4eb-d7cb-44e6-894a-bdcfc7121e29 req-acbc1643-3a5a-4d8d-9fe5-e3a818cb6d38 service nova] Enqueued Resource ID: 54bba0b8-b95d-4902-8afe-f2600efb516b with Priority: HIGHEST for action security_group_members [ 638.786016] env[71140]: INFO networking_nsxv3.common.synchronization [req-986fc4eb-d7cb-44e6-894a-bdcfc7121e29 req-acbc1643-3a5a-4d8d-9fe5-e3a818cb6d38 service nova] Enqueued Resource ID: c1f52d7f-aaf7-446d-9a45-8c273a99a5f4 with Priority: HIGHEST for action port [ 638.786363] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54bba0b8-b95d-4902-8afe-f2600efb516b with Priority: HIGHEST for action security_group_rules [ 638.786363] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54bba0b8-b95d-4902-8afe-f2600efb516b with Priority: HIGHEST for action security_group_members [ 638.786363] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1f52d7f-aaf7-446d-9a45-8c273a99a5f4 with Priority: HIGHEST for action port [ 638.787361] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54bba0b8-b95d-4902-8afe-f2600efb516b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.787567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.787605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.787845] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.789209] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54bba0b8-b95d-4902-8afe-f2600efb516b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.789977] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-54bba0b8-b95d-4902-8afe-f2600efb516b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.790137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.790293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.790828] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.791096] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.792146] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.792240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.792476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.792602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.792741] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54bba0b8-b95d-4902-8afe-f2600efb516b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.793895] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1f52d7f-aaf7-446d-9a45-8c273a99a5f4 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.793895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1f52d7f-aaf7-446d-9a45-8c273a99a5f4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.793895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1f52d7f-aaf7-446d-9a45-8c273a99a5f4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.794085] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1f52d7f-aaf7-446d-9a45-8c273a99a5f4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.794085] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1f52d7f-aaf7-446d-9a45-8c273a99a5f4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.797090] env[71140]: INFO networking_nsxv3.common.synchronization [req-72bec258-7e34-4b33-ac56-79033327c757 req-1d5346fd-a4f9-44f3-ae6f-ecbe403d95ce tempest-MigrationsAdminTest-2143534678 tempest-MigrationsAdminTest-2143534678-project-member] Enqueued Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGHEST for action security_group_members [ 638.797760] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGHEST for action security_group_members [ 638.798916] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.798916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.798916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.798916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.798916] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.798916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.798916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.799262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.799262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.799262] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.177021] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.177021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.177021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.177021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.177021] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.177021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.177021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.177823] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.178088] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.178869] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.178869] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.178869] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.178869] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.178869] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.178869] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.179050] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.197463] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.197463] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 639.197556] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.197689] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.197689] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-900b9dc1-5c5b-4932-b885-e764ba7b83e9 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.197689] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-900b9dc1-5c5b-4932-b885-e764ba7b83e9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.197689] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-900b9dc1-5c5b-4932-b885-e764ba7b83e9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.198692] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-900b9dc1-5c5b-4932-b885-e764ba7b83e9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.198788] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('900b9dc1-5c5b-4932-b885-e764ba7b83e9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.230235] env[71140]: INFO networking_nsxv3.common.synchronization [None req-43c10254-f27b-4102-962d-aaecc5346236 None None] Enqueued Resource ID: 6695c2a9-caaf-4f03-ba6f-b7807f1aca25 with Priority: HIGHEST for action port [ 639.230235] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6695c2a9-caaf-4f03-ba6f-b7807f1aca25 with Priority: HIGHEST for action port [ 639.231709] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-6695c2a9-caaf-4f03-ba6f-b7807f1aca25 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.232455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6695c2a9-caaf-4f03-ba6f-b7807f1aca25" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.233861] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6695c2a9-caaf-4f03-ba6f-b7807f1aca25" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.233861] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6695c2a9-caaf-4f03-ba6f-b7807f1aca25" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.233861] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6695c2a9-caaf-4f03-ba6f-b7807f1aca25',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.291835] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-54bba0b8-b95d-4902-8afe-f2600efb516b taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.291835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.297537] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54bba0b8-b95d-4902-8afe-f2600efb516b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.306293] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.306293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.306293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.306293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.306293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.306293] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.306293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.306293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.306293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.311034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.312073] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0021f162-837d-4356-afbf-4e10e33828d6 already deleted. [ 639.312073] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.316114] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1f52d7f-aaf7-446d-9a45-8c273a99a5f4 with status ACTIVE [ 639.316114] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.316114] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.316114] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.316114] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.316480] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.316480] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.316480] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.316587] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.316680] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.317738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.317738] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.317738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.317738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.317738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.318096] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.318359] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1f52d7f-aaf7-446d-9a45-8c273a99a5f4 is going to be updated. [ 639.339277] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.340919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.340919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.340919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.340919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.340919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1f52d7f-aaf7-446d-9a45-8c273a99a5f4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.658502] env[71140]: INFO networking_nsxv3.common.synchronization [req-f98dc303-257a-49c8-aa82-044d4b26acc0 req-357a98e1-c47f-4c2d-8c27-ffb5447060a1 tempest-SecurityGroupRulesNegativeTestJSON-1476014075 tempest-SecurityGroupRulesNegativeTestJSON-1476014075-project-member] Enqueued Resource ID: 78eff523-917e-40d5-a827-718710a49d67 with Priority: HIGHEST for action security_group_rules [ 639.659031] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78eff523-917e-40d5-a827-718710a49d67 with Priority: HIGHEST for action security_group_rules [ 639.659334] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78eff523-917e-40d5-a827-718710a49d67 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.659615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78eff523-917e-40d5-a827-718710a49d67" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.659615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78eff523-917e-40d5-a827-718710a49d67" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.659709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78eff523-917e-40d5-a827-718710a49d67" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.659782] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78eff523-917e-40d5-a827-718710a49d67',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.702586] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.705158] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.705158] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.705158] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.705158] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.705158] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 900b9dc1-5c5b-4932-b885-e764ba7b83e9 not found, creating... [ 639.705666] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.706253] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.706859] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.708016] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.708016] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.708016] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.708016] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.708322] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.711035] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.711035] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.711035] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 900b9dc1-5c5b-4932-b885-e764ba7b83e9 is going to be created. [ 639.729308] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.729711] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.729935] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.730283] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.730683] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.731702] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-900b9dc1-5c5b-4932-b885-e764ba7b83e9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.740246] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6695c2a9-caaf-4f03-ba6f-b7807f1aca25 [ 639.740246] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.740246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.740246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.740246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.740246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.740246] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6695c2a9-caaf-4f03-ba6f-b7807f1aca25 already deleted. [ 639.740246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6695c2a9-caaf-4f03-ba6f-b7807f1aca25" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.804636] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54bba0b8-b95d-4902-8afe-f2600efb516b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.180146] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.180309] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.180414] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.181653] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.181653] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.181653] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78eff523-917e-40d5-a827-718710a49d67 already deleted. [ 640.181653] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78eff523-917e-40d5-a827-718710a49d67" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.308555] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.308727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.308780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.308991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.309093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.309340] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54bba0b8-b95d-4902-8afe-f2600efb516b is going to be created. [ 640.340443] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.342661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.342661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.342661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.342661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.352693] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54bba0b8-b95d-4902-8afe-f2600efb516b in Status: UNINITIALIZED for 2s [ 640.885786] env[71140]: INFO networking_nsxv3.common.synchronization [req-72bec258-7e34-4b33-ac56-79033327c757 req-e6e706f4-2e0b-469e-b9e0-e8fa80139399 service nova] Enqueued Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGHEST for action security_group_rules [ 640.885786] env[71140]: INFO networking_nsxv3.common.synchronization [req-72bec258-7e34-4b33-ac56-79033327c757 req-e6e706f4-2e0b-469e-b9e0-e8fa80139399 service nova] Enqueued Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGHEST for action security_group_members [ 640.885786] env[71140]: INFO networking_nsxv3.common.synchronization [req-72bec258-7e34-4b33-ac56-79033327c757 req-e6e706f4-2e0b-469e-b9e0-e8fa80139399 service nova] Enqueued Resource ID: 900b9dc1-5c5b-4932-b885-e764ba7b83e9 with Priority: HIGHEST for action port [ 640.885786] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGHEST for action security_group_rules [ 640.885786] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGHEST for action security_group_members [ 640.885786] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 900b9dc1-5c5b-4932-b885-e764ba7b83e9 with Priority: HIGHEST for action port [ 640.886314] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.886314] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.886885] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.887181] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.887267] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.890042] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.890042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.890042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.890211] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.891199] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.891199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.891199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.891199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.891199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.891199] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.891943] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-900b9dc1-5c5b-4932-b885-e764ba7b83e9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.894047] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-900b9dc1-5c5b-4932-b885-e764ba7b83e9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.894047] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-900b9dc1-5c5b-4932-b885-e764ba7b83e9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.894471] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-900b9dc1-5c5b-4932-b885-e764ba7b83e9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.894471] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('900b9dc1-5c5b-4932-b885-e764ba7b83e9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.344498] env[71140]: INFO networking_nsxv3.common.synchronization [None req-b70f3394-b825-4f1a-b779-34c3efca6acf tempest-VolumesAssistedSnapshotsTest-1122912751 tempest-VolumesAssistedSnapshotsTest-1122912751-project-member] Enqueued Resource ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 with Priority: HIGHEST for action security_group_rules [ 641.345129] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 with Priority: HIGHEST for action security_group_rules [ 641.345343] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.345597] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.345597] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.345812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.346051] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1516d35-770d-4ac2-bf00-b0eed6f837f7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.397418] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.397686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.397792] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.410216] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 900b9dc1-5c5b-4932-b885-e764ba7b83e9 with status ACTIVE [ 641.410419] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.410570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.410627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.410825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.410895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.411166] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.411268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.411327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.411487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.411563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.411767] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.411899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.411899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.412089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.412128] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.412308] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 900b9dc1-5c5b-4932-b885-e764ba7b83e9 is going to be updated. [ 641.432362] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.432482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.432591] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.432763] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.432896] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.433059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-900b9dc1-5c5b-4932-b885-e764ba7b83e9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.511261] env[71140]: INFO networking_nsxv3.common.synchronization [None req-c9ae518e-e890-424a-aa26-94bb74ef90ea tempest-VolumesAssistedSnapshotsTest-1122912751 tempest-VolumesAssistedSnapshotsTest-1122912751-project-member] Enqueued Resource ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 with Priority: HIGHEST for action security_group_rules [ 641.512072] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 with Priority: HIGHEST for action security_group_rules [ 641.512208] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.512269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.868065] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.868586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.868767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.869057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.869234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.869986] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 already deleted. [ 641.870218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.874415] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.874415] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.874415] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1516d35-770d-4ac2-bf00-b0eed6f837f7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.900879] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.944034] env[71140]: INFO networking_nsxv3.common.synchronization [None req-5ce18d45-d2dd-4bd5-9e5b-b5e1f5321df6 None None] Enqueued Resource ID: 47137e5e-e5b9-440b-861e-0942a7c3229b with Priority: HIGHEST for action port [ 641.944485] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47137e5e-e5b9-440b-861e-0942a7c3229b with Priority: HIGHEST for action port [ 641.944929] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-47137e5e-e5b9-440b-861e-0942a7c3229b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.945011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47137e5e-e5b9-440b-861e-0942a7c3229b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.945100] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47137e5e-e5b9-440b-861e-0942a7c3229b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.945372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47137e5e-e5b9-440b-861e-0942a7c3229b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.945484] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47137e5e-e5b9-440b-861e-0942a7c3229b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.196900] env[71140]: INFO networking_nsxv3.common.synchronization [None req-07e1b3cd-69e9-424e-8599-5229a148300d None None] Enqueued Resource ID: a06724b5-6d0a-4df2-9065-c8a2ae9e09b5 with Priority: HIGHEST for action port [ 642.196900] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a06724b5-6d0a-4df2-9065-c8a2ae9e09b5 with Priority: HIGHEST for action port [ 642.197233] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-a06724b5-6d0a-4df2-9065-c8a2ae9e09b5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.197384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a06724b5-6d0a-4df2-9065-c8a2ae9e09b5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.197473] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a06724b5-6d0a-4df2-9065-c8a2ae9e09b5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.197698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a06724b5-6d0a-4df2-9065-c8a2ae9e09b5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.197746] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a06724b5-6d0a-4df2-9065-c8a2ae9e09b5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.362118] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54bba0b8-b95d-4902-8afe-f2600efb516b in Status: SUCCESS [ 642.362441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.362607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.362819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.363445] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.363647] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.363712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.363889] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.364610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.367058] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.367202] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54bba0b8-b95d-4902-8afe-f2600efb516b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.394183] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.394183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.394183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.394183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.394183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.394183] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 already deleted. [ 642.394183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.404164] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.404497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.404497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.404600] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.404667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.404877] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0021f162-837d-4356-afbf-4e10e33828d6 is going to be created. [ 642.429876] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.430505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.430505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.430505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.430685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.439297] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0021f162-837d-4356-afbf-4e10e33828d6 in Status: UNINITIALIZED for 2s [ 642.448553] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47137e5e-e5b9-440b-861e-0942a7c3229b [ 642.448694] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.448783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.448886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.449144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.449248] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.449322] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47137e5e-e5b9-440b-861e-0942a7c3229b already deleted. [ 642.449402] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47137e5e-e5b9-440b-861e-0942a7c3229b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.706117] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a06724b5-6d0a-4df2-9065-c8a2ae9e09b5 [ 642.706532] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.706832] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.708718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.708718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.708718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.708718] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a06724b5-6d0a-4df2-9065-c8a2ae9e09b5 already deleted. [ 642.708718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a06724b5-6d0a-4df2-9065-c8a2ae9e09b5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.745204] env[71140]: INFO networking_nsxv3.common.synchronization [None req-4e44cc54-d323-4863-ba6c-61bce6807413 None None] Enqueued Resource ID: 2e9f7d1f-0c1f-43e6-96b6-602a0caeb054 with Priority: HIGHEST for action port [ 642.745565] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e9f7d1f-0c1f-43e6-96b6-602a0caeb054 with Priority: HIGHEST for action port [ 642.747520] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e9f7d1f-0c1f-43e6-96b6-602a0caeb054 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.748206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e9f7d1f-0c1f-43e6-96b6-602a0caeb054" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.748206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e9f7d1f-0c1f-43e6-96b6-602a0caeb054" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.748635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e9f7d1f-0c1f-43e6-96b6-602a0caeb054" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.748635] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e9f7d1f-0c1f-43e6-96b6-602a0caeb054',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.869300] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-54bba0b8-b95d-4902-8afe-f2600efb516b taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.870634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.870634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.870634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.871925] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.871925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.871925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.871925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.871925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.871925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.871925] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-54bba0b8-b95d-4902-8afe-f2600efb516b taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.871925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.871925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.875040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.875040] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.875040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.875040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.875040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.875040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.875040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.875040] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54bba0b8-b95d-4902-8afe-f2600efb516b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.948022] env[71140]: INFO networking_nsxv3.common.synchronization [None req-ccd13a24-1714-44aa-bd2e-294205e012f8 None None] Enqueued Resource ID: 339d1a17-0e53-44a7-835c-d9149a4dbd25 with Priority: HIGHEST for action port [ 642.952306] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 339d1a17-0e53-44a7-835c-d9149a4dbd25 with Priority: HIGHEST for action port [ 642.952306] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-339d1a17-0e53-44a7-835c-d9149a4dbd25 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.952306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-339d1a17-0e53-44a7-835c-d9149a4dbd25" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.952306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-339d1a17-0e53-44a7-835c-d9149a4dbd25" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.952306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-339d1a17-0e53-44a7-835c-d9149a4dbd25" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.952306] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('339d1a17-0e53-44a7-835c-d9149a4dbd25',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.168317] env[71140]: INFO networking_nsxv3.common.synchronization [None req-f9d24145-c59b-4839-bb3c-9408390b9040 None None] Enqueued Resource ID: 89b0459a-ad0e-4900-a3f7-ada8834536b5 with Priority: HIGHEST for action port [ 643.168317] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b0459a-ad0e-4900-a3f7-ada8834536b5 with Priority: HIGHEST for action port [ 643.168317] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-89b0459a-ad0e-4900-a3f7-ada8834536b5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.168317] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89b0459a-ad0e-4900-a3f7-ada8834536b5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.168317] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89b0459a-ad0e-4900-a3f7-ada8834536b5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.168317] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89b0459a-ad0e-4900-a3f7-ada8834536b5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.168317] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89b0459a-ad0e-4900-a3f7-ada8834536b5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.250842] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e9f7d1f-0c1f-43e6-96b6-602a0caeb054 [ 643.251962] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.253348] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.254278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.254278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.254278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.254278] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e9f7d1f-0c1f-43e6-96b6-602a0caeb054 already deleted. [ 643.254278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e9f7d1f-0c1f-43e6-96b6-602a0caeb054" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.377878] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54bba0b8-b95d-4902-8afe-f2600efb516b: rpc.has_security_group_logging(os_id): False [ 643.390180] env[71140]: INFO networking_nsxv3.common.synchronization [req-36e85777-936a-4b6a-87df-eac9e09613f4 req-1339d68c-ed06-43b5-bdcb-879382573c23 tempest-FloatingIPsAssociationNegativeTestJSON-1978447561 tempest-FloatingIPsAssociationNegativeTestJSON-1978447561-project-member] Enqueued Resource ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 with Priority: HIGHEST for action security_group_members [ 643.390180] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 with Priority: HIGHEST for action security_group_members [ 643.390180] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f065f4e4-d6ea-4bca-9d45-213c57a908b4 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.390313] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.390313] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.390542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.390697] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.393129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.393246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.393389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.393476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.393585] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f065f4e4-d6ea-4bca-9d45-213c57a908b4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.398536] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.398691] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.398733] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.398922] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.401573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.401894] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.402052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.402554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.402554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.402554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.402696] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.403239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.403325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.403504] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.403585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.403806] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.403918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.404027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.404289] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.404365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.404453] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54bba0b8-b95d-4902-8afe-f2600efb516b is going to be created. [ 643.455029] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 339d1a17-0e53-44a7-835c-d9149a4dbd25 [ 643.455029] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.455029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.455029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.456424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.456537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.456667] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:339d1a17-0e53-44a7-835c-d9149a4dbd25 already deleted. [ 643.456730] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-339d1a17-0e53-44a7-835c-d9149a4dbd25" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.473780] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.473780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.473780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.473780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.473780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.489445] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54bba0b8-b95d-4902-8afe-f2600efb516b in Status: IN_PROGRESS for 2s [ 643.672314] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89b0459a-ad0e-4900-a3f7-ada8834536b5 [ 643.672954] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.672954] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.672954] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.673198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.673198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.673198] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89b0459a-ad0e-4900-a3f7-ada8834536b5 already deleted. [ 643.673327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89b0459a-ad0e-4900-a3f7-ada8834536b5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.899080] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.899387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.899387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.899570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.899707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.899978] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.900108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.900169] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.900396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.900396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.900608] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 already deleted. [ 643.900705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.960276] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.960577] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-344" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.960577] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-344" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.960952] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-344" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.962540] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.963186] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.963186] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.963304] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.963428] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.963654] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.963772] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.963911] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.964028] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.964137] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.964280] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.964427] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.982230] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.982407] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 643.983070] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.983070] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-344" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.983070] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-5665450c-fd11-4314-8491-48c413320f7d taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.983290] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-5665450c-fd11-4314-8491-48c413320f7d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.983360] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-5665450c-fd11-4314-8491-48c413320f7d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.983678] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-5665450c-fd11-4314-8491-48c413320f7d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.985547] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5665450c-fd11-4314-8491-48c413320f7d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.455695] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0021f162-837d-4356-afbf-4e10e33828d6 in Status: SUCCESS [ 644.458792] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.459184] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.459482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.459636] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.460037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.460037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.460037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.460037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.460307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.460307] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.490082] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.490393] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.490618] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.491038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.491255] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.492325] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 5665450c-fd11-4314-8491-48c413320f7d not found, creating... [ 644.492474] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.492769] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.492961] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.493334] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.493483] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.493844] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.494965] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.494965] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.494965] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.494965] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.494965] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 5665450c-fd11-4314-8491-48c413320f7d is going to be created. [ 644.515669] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.515669] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.515669] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.515669] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.515669] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.518977] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-5665450c-fd11-4314-8491-48c413320f7d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.965952] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.965952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.965952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.965952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.965952] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.965952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.965952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.965952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.965952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.965952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.965952] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.965952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.965952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.965952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.967021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.967021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.967021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.967021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.967021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.967021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.967021] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.470017] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0021f162-837d-4356-afbf-4e10e33828d6: rpc.has_security_group_logging(os_id): False [ 645.493023] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.493023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.493219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.493736] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.493736] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.493736] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.493900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.493900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.494788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.494788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.494788] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.494973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.494973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.495135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.495135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.496795] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.496795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.496795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.496795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.496795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.496795] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0021f162-837d-4356-afbf-4e10e33828d6 is going to be created. [ 645.517919] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54bba0b8-b95d-4902-8afe-f2600efb516b in Status: SUCCESS [ 645.517919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.552636] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.552636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.552636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.552636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.552636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.564338] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0021f162-837d-4356-afbf-4e10e33828d6 in Status: IN_PROGRESS for 2s [ 645.868791] env[71140]: INFO networking_nsxv3.common.synchronization [req-36e85777-936a-4b6a-87df-eac9e09613f4 req-23439c74-496f-4f01-b381-11fce1bc0508 service nova] Enqueued Resource ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 with Priority: HIGHEST for action security_group_rules [ 645.868791] env[71140]: INFO networking_nsxv3.common.synchronization [req-36e85777-936a-4b6a-87df-eac9e09613f4 req-23439c74-496f-4f01-b381-11fce1bc0508 service nova] Enqueued Resource ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 with Priority: HIGHEST for action security_group_members [ 645.868791] env[71140]: INFO networking_nsxv3.common.synchronization [req-36e85777-936a-4b6a-87df-eac9e09613f4 req-23439c74-496f-4f01-b381-11fce1bc0508 service nova] Enqueued Resource ID: 5665450c-fd11-4314-8491-48c413320f7d with Priority: HIGHEST for action port [ 645.868791] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 with Priority: HIGHEST for action security_group_rules [ 645.868791] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 with Priority: HIGHEST for action security_group_members [ 645.868791] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5665450c-fd11-4314-8491-48c413320f7d with Priority: HIGHEST for action port [ 645.870042] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f065f4e4-d6ea-4bca-9d45-213c57a908b4 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.870042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.870042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.870042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.870305] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f065f4e4-d6ea-4bca-9d45-213c57a908b4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.874676] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f065f4e4-d6ea-4bca-9d45-213c57a908b4 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.874808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.875764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.875995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.876177] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.876282] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.876352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.876514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.876606] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.876714] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f065f4e4-d6ea-4bca-9d45-213c57a908b4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.877487] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-5665450c-fd11-4314-8491-48c413320f7d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.877599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5665450c-fd11-4314-8491-48c413320f7d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.877663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5665450c-fd11-4314-8491-48c413320f7d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.877840] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5665450c-fd11-4314-8491-48c413320f7d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.877881] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5665450c-fd11-4314-8491-48c413320f7d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.072453] env[71140]: INFO networking_nsxv3.common.synchronization [req-41989d33-cc4b-4cc7-8341-9c915e44c79c req-8ab593c6-c91f-4c0a-b1a2-070b1a307f0e tempest-ServerExternalEventsTest-516530908 tempest-ServerExternalEventsTest-516530908-project-member] Enqueued Resource ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be with Priority: HIGHEST for action security_group_members [ 646.072910] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be with Priority: HIGHEST for action security_group_members [ 646.073436] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.073436] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.073436] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.073717] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.073838] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.073916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.073977] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.074465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.074709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.074913] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fa22f34-dd54-4c36-9be4-89ad63b6e1be',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.381482] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f065f4e4-d6ea-4bca-9d45-213c57a908b4 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.381696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.381828] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f065f4e4-d6ea-4bca-9d45-213c57a908b4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.383596] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5665450c-fd11-4314-8491-48c413320f7d with status ACTIVE [ 646.383816] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.384190] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.384326] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.384684] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.384797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.384991] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.385360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.385451] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.386822] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.386967] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.388247] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.388247] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.388247] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.389924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.390035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.390753] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5665450c-fd11-4314-8491-48c413320f7d is going to be updated. [ 646.410674] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.410674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.410674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.410674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.410674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.410674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5665450c-fd11-4314-8491-48c413320f7d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.577931] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.578298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.578407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.578857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.579943] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.580226] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.580371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.580460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.580653] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.580797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.580963] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be already deleted. [ 646.580963] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.754063] env[71140]: INFO networking_nsxv3.common.synchronization [None req-28029cb7-42af-4343-ade1-69f3c6234516 None None] Enqueued Resource ID: 444ca4fd-2f3c-4183-83dd-7caf175a7d98 with Priority: HIGHEST for action port [ 646.756034] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 444ca4fd-2f3c-4183-83dd-7caf175a7d98 with Priority: HIGHEST for action port [ 646.756034] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-444ca4fd-2f3c-4183-83dd-7caf175a7d98 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.756034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-444ca4fd-2f3c-4183-83dd-7caf175a7d98" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.756034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-444ca4fd-2f3c-4183-83dd-7caf175a7d98" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.756034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-444ca4fd-2f3c-4183-83dd-7caf175a7d98" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.756034] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('444ca4fd-2f3c-4183-83dd-7caf175a7d98',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.763719] env[71140]: INFO networking_nsxv3.common.synchronization [None req-5b98c136-d301-4ea0-9f4b-c95adb4fe592 None None] Enqueued Resource ID: c2c8461c-f098-44f9-8c65-55a5e875e632 with Priority: HIGHEST for action port [ 646.764047] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2c8461c-f098-44f9-8c65-55a5e875e632 with Priority: HIGHEST for action port [ 646.765143] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2c8461c-f098-44f9-8c65-55a5e875e632 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.765143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2c8461c-f098-44f9-8c65-55a5e875e632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.765143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2c8461c-f098-44f9-8c65-55a5e875e632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.765143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2c8461c-f098-44f9-8c65-55a5e875e632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.765465] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2c8461c-f098-44f9-8c65-55a5e875e632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.896465] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f065f4e4-d6ea-4bca-9d45-213c57a908b4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.121832] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.122136] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.122136] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.122391] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.122642] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.122796] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.122913] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.123314] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.123531] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.124151] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 647.124390] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.124390] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.124507] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.124620] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 647.124729] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.124869] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.145392] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.145392] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 647.145392] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.145392] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.145392] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-90f7b587-ca2b-4c09-8f63-81086f25e193 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.145392] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-90f7b587-ca2b-4c09-8f63-81086f25e193" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.145392] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-90f7b587-ca2b-4c09-8f63-81086f25e193" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.145392] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-90f7b587-ca2b-4c09-8f63-81086f25e193" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.145392] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90f7b587-ca2b-4c09-8f63-81086f25e193',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.228870] env[71140]: INFO networking_nsxv3.common.synchronization [None req-02a4fa35-760d-4fca-aa5d-4f68f9b636c5 None None] Enqueued Resource ID: ac4105b3-d572-4c34-8546-267ac882d343 with Priority: HIGHEST for action port [ 647.230589] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4105b3-d572-4c34-8546-267ac882d343 with Priority: HIGHEST for action port [ 647.231189] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac4105b3-d572-4c34-8546-267ac882d343 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.231360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac4105b3-d572-4c34-8546-267ac882d343" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.231410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac4105b3-d572-4c34-8546-267ac882d343" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.231740] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac4105b3-d572-4c34-8546-267ac882d343" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.231820] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac4105b3-d572-4c34-8546-267ac882d343',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.258177] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 444ca4fd-2f3c-4183-83dd-7caf175a7d98 [ 647.258429] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.258576] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.258645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.258949] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.259141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.259261] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:444ca4fd-2f3c-4183-83dd-7caf175a7d98 already deleted. [ 647.259372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-444ca4fd-2f3c-4183-83dd-7caf175a7d98" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.272908] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2c8461c-f098-44f9-8c65-55a5e875e632 [ 647.273427] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.273643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.274189] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.274384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.274512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.274809] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2c8461c-f098-44f9-8c65-55a5e875e632 already deleted. [ 647.274943] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2c8461c-f098-44f9-8c65-55a5e875e632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.401717] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.402509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.402591] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.402815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.402914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.403034] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 is going to be created. [ 647.428706] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.428706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.428706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.428706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.428706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.438093] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 in Status: UNINITIALIZED for 2s [ 647.575257] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0021f162-837d-4356-afbf-4e10e33828d6 in Status: SUCCESS [ 647.575494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.649406] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.649633] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.649765] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.650094] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.650256] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.650413] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 90f7b587-ca2b-4c09-8f63-81086f25e193 not found, creating... [ 647.650694] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.651219] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.651219] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.651219] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.651360] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.651634] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.652737] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.652737] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.652904] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.653091] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.653254] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 90f7b587-ca2b-4c09-8f63-81086f25e193 is going to be created. [ 647.676091] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.681639] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.681639] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.681639] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.681639] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.681639] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-90f7b587-ca2b-4c09-8f63-81086f25e193" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.737022] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac4105b3-d572-4c34-8546-267ac882d343 [ 647.737022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.737022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.737022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.737022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.737022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.737022] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac4105b3-d572-4c34-8546-267ac882d343 already deleted. [ 647.737022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac4105b3-d572-4c34-8546-267ac882d343" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.815315] env[71140]: INFO networking_nsxv3.common.synchronization [req-73b678bc-b395-4040-be3d-1269d4a48301 req-3c10598c-ab04-45a2-8ade-1dd32c20c36b tempest-ServersAdminTestJSON-2080308680 tempest-ServersAdminTestJSON-2080308680-project-member] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 647.815806] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 647.816112] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.816255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.816323] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.816558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.816730] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.816838] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.816896] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.817726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.817726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.817726] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.095275] env[71140]: INFO networking_nsxv3.common.synchronization [None req-6c2a1fb3-479c-4dd4-b2d1-8e0e03e4152e tempest-ServersWithSpecificFlavorTestJSON-1339181312 tempest-ServersWithSpecificFlavorTestJSON-1339181312-project-member] Enqueued Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_rules [ 648.095275] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_rules [ 648.095275] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c62a92b8-4863-4e9d-809d-e8687b429f2a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.095725] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.095819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.096107] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.096211] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.260026] env[71140]: INFO networking_nsxv3.common.synchronization [None req-ecddc570-1752-401b-9712-d932f09f0d8e tempest-ServersWithSpecificFlavorTestJSON-1339181312 tempest-ServersWithSpecificFlavorTestJSON-1339181312-project-member] Enqueued Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_rules [ 648.260026] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_rules [ 648.260026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c62a92b8-4863-4e9d-809d-e8687b429f2a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.260026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.321206] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.321206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.321206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.321206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.321206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.322434] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.322599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.322675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.322881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.322961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.323068] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 184bb91c-9526-466a-820b-ced20908d98e already deleted. [ 648.323147] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.335069] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-181 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.335278] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-181" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.335414] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-181" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.335802] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-181" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.336328] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.336946] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.336946] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.337164] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.337545] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.337545] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.337646] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.337824] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.337824] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.338350] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.338350] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.338350] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.375288] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.375288] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 648.375411] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.378768] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-181" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.378768] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-c0face6b-0867-48f0-9031-86b05c2732f3 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.378768] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-c0face6b-0867-48f0-9031-86b05c2732f3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.378768] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-c0face6b-0867-48f0-9031-86b05c2732f3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.378768] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-c0face6b-0867-48f0-9031-86b05c2732f3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.378768] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0face6b-0867-48f0-9031-86b05c2732f3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.613670] env[71140]: INFO networking_nsxv3.common.synchronization [req-41989d33-cc4b-4cc7-8341-9c915e44c79c req-6adfaf2f-46d2-49b3-8106-3bcc90b3ac48 service nova] Enqueued Resource ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be with Priority: HIGHEST for action security_group_rules [ 648.613670] env[71140]: INFO networking_nsxv3.common.synchronization [req-41989d33-cc4b-4cc7-8341-9c915e44c79c req-6adfaf2f-46d2-49b3-8106-3bcc90b3ac48 service nova] Enqueued Resource ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be with Priority: HIGHEST for action security_group_members [ 648.613670] env[71140]: INFO networking_nsxv3.common.synchronization [req-41989d33-cc4b-4cc7-8341-9c915e44c79c req-6adfaf2f-46d2-49b3-8106-3bcc90b3ac48 service nova] Enqueued Resource ID: 90f7b587-ca2b-4c09-8f63-81086f25e193 with Priority: HIGHEST for action port [ 648.614226] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be with Priority: HIGHEST for action security_group_rules [ 648.614419] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be with Priority: HIGHEST for action security_group_members [ 648.614518] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90f7b587-ca2b-4c09-8f63-81086f25e193 with Priority: HIGHEST for action port [ 648.614856] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fa22f34-dd54-4c36-9be4-89ad63b6e1be taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.614976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.614976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.615263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.615342] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fa22f34-dd54-4c36-9be4-89ad63b6e1be',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.616752] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.617420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.617420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.617420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.617420] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.617420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.617420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.617707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.617707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.617778] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fa22f34-dd54-4c36-9be4-89ad63b6e1be',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.618576] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-90f7b587-ca2b-4c09-8f63-81086f25e193 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.618676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90f7b587-ca2b-4c09-8f63-81086f25e193" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.618750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90f7b587-ca2b-4c09-8f63-81086f25e193" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.618911] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90f7b587-ca2b-4c09-8f63-81086f25e193" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.618985] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90f7b587-ca2b-4c09-8f63-81086f25e193',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.620951] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.621069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.621227] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.621268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.621462] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.621542] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c62a92b8-4863-4e9d-809d-e8687b429f2a already deleted. [ 648.621602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.622333] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.622498] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.622584] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.880857] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.881107] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.881402] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.881513] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.882229] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.882229] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port c0face6b-0867-48f0-9031-86b05c2732f3 not found, creating... [ 648.882229] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.882229] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.882566] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.882566] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.882704] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.882946] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.883110] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.883249] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.883474] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.883661] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.883879] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: c0face6b-0867-48f0-9031-86b05c2732f3 is going to be created. [ 648.905136] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.905136] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.905136] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.905136] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.905136] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.905136] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-c0face6b-0867-48f0-9031-86b05c2732f3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.122677] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.123700] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.123700] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8fa22f34-dd54-4c36-9be4-89ad63b6e1be',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.125032] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90f7b587-ca2b-4c09-8f63-81086f25e193 with status ACTIVE [ 649.125115] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.126039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.126039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.126039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.126039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.126039] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.126039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.126039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.126536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.126536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.126536] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.126536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.126536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.126806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.126806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.126806] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90f7b587-ca2b-4c09-8f63-81086f25e193 is going to be updated. [ 649.146103] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.146369] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.146369] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.146621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.146803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.146803] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c62a92b8-4863-4e9d-809d-e8687b429f2a already deleted. [ 649.147016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.148347] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.148509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.148579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.148758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.148907] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.149144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90f7b587-ca2b-4c09-8f63-81086f25e193" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.191050] env[71140]: INFO networking_nsxv3.common.synchronization [None req-f08468c0-d513-47ed-b807-82828d354682 tempest-VolumesAdminNegativeTest-302320000 tempest-VolumesAdminNegativeTest-302320000-project-member] Enqueued Resource ID: bc92ef18-2831-4b38-acbe-82e66080661f with Priority: HIGHEST for action security_group_rules [ 649.191373] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc92ef18-2831-4b38-acbe-82e66080661f with Priority: HIGHEST for action security_group_rules [ 649.191763] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc92ef18-2831-4b38-acbe-82e66080661f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.191763] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.191873] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.192762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.192886] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc92ef18-2831-4b38-acbe-82e66080661f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.352611] env[71140]: INFO networking_nsxv3.common.synchronization [None req-932f7117-19e0-482d-a5d6-80bfae728c06 tempest-VolumesAdminNegativeTest-302320000 tempest-VolumesAdminNegativeTest-302320000-project-member] Enqueued Resource ID: bc92ef18-2831-4b38-acbe-82e66080661f with Priority: HIGHEST for action security_group_rules [ 649.353301] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc92ef18-2831-4b38-acbe-82e66080661f with Priority: HIGHEST for action security_group_rules [ 649.353301] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc92ef18-2831-4b38-acbe-82e66080661f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.353301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.449473] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 in Status: SUCCESS [ 649.450227] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.450227] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.450502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.450502] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.450592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.450662] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.450829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.450953] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.451483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.451580] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f065f4e4-d6ea-4bca-9d45-213c57a908b4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.625940] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8fa22f34-dd54-4c36-9be4-89ad63b6e1be',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.713819] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.713819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.713819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.713819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.713819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.713819] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc92ef18-2831-4b38-acbe-82e66080661f already deleted. [ 649.713819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.713819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.713819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.713819] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc92ef18-2831-4b38-acbe-82e66080661f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.955484] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f065f4e4-d6ea-4bca-9d45-213c57a908b4 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.955694] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.955768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.956542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.956542] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.956542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.956542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.956542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.956542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.956878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.956878] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f065f4e4-d6ea-4bca-9d45-213c57a908b4 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.957964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.958154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.958813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.959057] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.959207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.959280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.959440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.959551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.959606] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.959847] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f065f4e4-d6ea-4bca-9d45-213c57a908b4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.128392] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.128567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.128642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.128868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.129252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.129252] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be is going to be created. [ 650.150602] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.150806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.151451] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.151451] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.151451] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.160414] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be in Status: UNINITIALIZED for 2s [ 650.241062] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.241062] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.241062] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.241062] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.241062] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.241062] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc92ef18-2831-4b38-acbe-82e66080661f already deleted. [ 650.241062] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.334227] env[71140]: INFO networking_nsxv3.common.synchronization [req-73b678bc-b395-4040-be3d-1269d4a48301 req-de34579f-baca-4d86-b81f-a08d5fdd6cf4 service nova] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_rules [ 650.334470] env[71140]: INFO networking_nsxv3.common.synchronization [req-73b678bc-b395-4040-be3d-1269d4a48301 req-de34579f-baca-4d86-b81f-a08d5fdd6cf4 service nova] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 650.334764] env[71140]: INFO networking_nsxv3.common.synchronization [req-73b678bc-b395-4040-be3d-1269d4a48301 req-de34579f-baca-4d86-b81f-a08d5fdd6cf4 service nova] Enqueued Resource ID: c0face6b-0867-48f0-9031-86b05c2732f3 with Priority: HIGHEST for action port [ 650.334848] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_rules [ 650.335050] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 650.335448] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0face6b-0867-48f0-9031-86b05c2732f3 with Priority: HIGHEST for action port [ 650.335617] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.335843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.335843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.336112] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.336181] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.337415] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.337556] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.337771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.338208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.338208] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.338208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.338208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.338757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.338757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.338757] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.344300] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0face6b-0867-48f0-9031-86b05c2732f3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.345251] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0face6b-0867-48f0-9031-86b05c2732f3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.345251] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0face6b-0867-48f0-9031-86b05c2732f3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.345251] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0face6b-0867-48f0-9031-86b05c2732f3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.345251] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0face6b-0867-48f0-9031-86b05c2732f3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.463733] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f065f4e4-d6ea-4bca-9d45-213c57a908b4: rpc.has_security_group_logging(os_id): False [ 650.481845] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.484080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.484080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.484080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.484080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.484080] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.484080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.484080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.484080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.484080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.484080] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.484080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.484080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.484080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.484080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.484532] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.486747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.486747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.486747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.486903] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.486903] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 is going to be created. [ 650.551261] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.551380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.551380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.553180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.555036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.563216] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 in Status: IN_PROGRESS for 2s [ 650.601713] env[71140]: INFO networking_nsxv3.common.synchronization [None req-7ce84f82-d8ca-4f24-90fb-a5db1391527b None None] Enqueued Resource ID: ebf87cca-d2ee-4531-8d87-8b87694d0191 with Priority: HIGHEST for action port [ 650.602700] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf87cca-d2ee-4531-8d87-8b87694d0191 with Priority: HIGHEST for action port [ 650.603023] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebf87cca-d2ee-4531-8d87-8b87694d0191 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.603936] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebf87cca-d2ee-4531-8d87-8b87694d0191" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.603936] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebf87cca-d2ee-4531-8d87-8b87694d0191" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.603936] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebf87cca-d2ee-4531-8d87-8b87694d0191" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.603936] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebf87cca-d2ee-4531-8d87-8b87694d0191',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.842788] env[71140]: INFO networking_nsxv3.common.synchronization [req-35ec4af1-362b-4119-bd53-44ddec91310e req-2ba55687-e559-4693-be02-5ba2aa0fc396 tempest-ServersAdminTestJSON-2080308680 tempest-ServersAdminTestJSON-2080308680-project-member] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 650.843529] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 650.843713] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.843971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.849692] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.849692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.849692] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.849692] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0face6b-0867-48f0-9031-86b05c2732f3 with status ACTIVE [ 650.849692] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.849692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.849692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.849692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.849692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.849692] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.849692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.849692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.850340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.850340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.850340] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.850340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.850340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.850516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.852735] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.852735] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0face6b-0867-48f0-9031-86b05c2732f3 is going to be updated. [ 650.872312] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.872462] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.872529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.872752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.872883] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.873061] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0face6b-0867-48f0-9031-86b05c2732f3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.106495] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebf87cca-d2ee-4531-8d87-8b87694d0191 [ 651.107176] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.107341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.107407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.107685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.107793] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.107939] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebf87cca-d2ee-4531-8d87-8b87694d0191 already deleted. [ 651.107985] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebf87cca-d2ee-4531-8d87-8b87694d0191" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.353417] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.454559] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-181 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.454559] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-181" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.454559] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-181" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.454559] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-181" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.454954] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.455033] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.455116] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.455340] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.455479] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.455711] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.455819] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.455932] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.456053] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.456165] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.456269] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.456408] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.474684] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.474966] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 651.475019] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.475190] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-181" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.475691] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-df3c2860-e7e2-41d4-a7dc-8715182ec710 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.475691] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-df3c2860-e7e2-41d4-a7dc-8715182ec710" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.475848] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-df3c2860-e7e2-41d4-a7dc-8715182ec710" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.476207] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-df3c2860-e7e2-41d4-a7dc-8715182ec710" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.476352] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df3c2860-e7e2-41d4-a7dc-8715182ec710',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.856727] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.857222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.857337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.857593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.857817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.857957] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be created. [ 651.882936] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.882936] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.882936] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.882936] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.882936] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.890249] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: UNINITIALIZED for 2s [ 651.979689] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.980012] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.980191] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.980560] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.980770] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.980987] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port df3c2860-e7e2-41d4-a7dc-8715182ec710 not found, creating... [ 651.982273] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.982740] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.982927] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.983273] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.983544] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.984250] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.984470] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.984682] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.985182] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.985378] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.985584] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: df3c2860-e7e2-41d4-a7dc-8715182ec710 is going to be created. [ 652.006949] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.006949] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.006949] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.006949] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.006949] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.007507] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-df3c2860-e7e2-41d4-a7dc-8715182ec710" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.097242] env[71140]: INFO networking_nsxv3.common.synchronization [None req-3dba301b-3e30-4b7e-82fd-60c2d0cecc30 None None] Enqueued Resource ID: 8feabbe5-ee16-40a4-8f20-c21a417c3545 with Priority: HIGHEST for action port [ 652.097575] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8feabbe5-ee16-40a4-8f20-c21a417c3545 with Priority: HIGHEST for action port [ 652.098082] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-8feabbe5-ee16-40a4-8f20-c21a417c3545 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.098207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8feabbe5-ee16-40a4-8f20-c21a417c3545" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.098272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8feabbe5-ee16-40a4-8f20-c21a417c3545" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.098519] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8feabbe5-ee16-40a4-8f20-c21a417c3545" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.098641] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8feabbe5-ee16-40a4-8f20-c21a417c3545',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.175673] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be in Status: SUCCESS [ 652.175956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.176483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.176720] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.176978] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.177111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.177212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.177333] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.177411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.177493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.177579] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8fa22f34-dd54-4c36-9be4-89ad63b6e1be',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.577512] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 in Status: SUCCESS [ 652.577834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.603229] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8feabbe5-ee16-40a4-8f20-c21a417c3545 [ 652.603797] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.603797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.603797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.604105] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.604271] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.604271] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8feabbe5-ee16-40a4-8f20-c21a417c3545 already deleted. [ 652.604372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8feabbe5-ee16-40a4-8f20-c21a417c3545" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.682485] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.682485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.682485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.682485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.682485] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.682485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.682485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.682485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.682485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.682485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.682485] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.682485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.682485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.682485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.684201] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.684201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.684201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.684201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.684201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.684201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.684201] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8fa22f34-dd54-4c36-9be4-89ad63b6e1be',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.188378] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8fa22f34-dd54-4c36-9be4-89ad63b6e1be: rpc.has_security_group_logging(os_id): False [ 653.204915] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.205048] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.205080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.205286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.205380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.205588] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.205693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.205784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.205967] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.206062] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.206281] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.206375] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.206439] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.206697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.206697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.206875] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.206961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.208688] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.208688] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.208688] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.208688] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be is going to be created. [ 653.267122] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.267122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.267122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.267122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.267122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.278325] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be in Status: IN_PROGRESS for 2s [ 653.333123] env[71140]: INFO networking_nsxv3.common.synchronization [req-649110a5-7f0e-4577-a539-0faf881aeaf8 req-477506e2-e399-4708-a322-295cdf982854 tempest-ServerDiagnosticsTest-1196517979 tempest-ServerDiagnosticsTest-1196517979-project-member] Enqueued Resource ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 with Priority: HIGHEST for action security_group_members [ 653.334892] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 with Priority: HIGHEST for action security_group_members [ 653.337410] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2accb7b-fbb3-4bd3-a819-611c041bf352 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.338084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.338601] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.340066] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.340066] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.340066] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.340066] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.340066] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.340066] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.340066] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2accb7b-fbb3-4bd3-a819-611c041bf352',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.343807] env[71140]: INFO networking_nsxv3.common.synchronization [req-35ec4af1-362b-4119-bd53-44ddec91310e req-503deff4-8358-4722-bb68-7e9722660cfe service nova] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_rules [ 653.343807] env[71140]: INFO networking_nsxv3.common.synchronization [req-35ec4af1-362b-4119-bd53-44ddec91310e req-503deff4-8358-4722-bb68-7e9722660cfe service nova] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 653.343807] env[71140]: INFO networking_nsxv3.common.synchronization [req-35ec4af1-362b-4119-bd53-44ddec91310e req-503deff4-8358-4722-bb68-7e9722660cfe service nova] Enqueued Resource ID: df3c2860-e7e2-41d4-a7dc-8715182ec710 with Priority: HIGHEST for action port [ 653.343939] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_rules [ 653.344752] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 653.344914] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df3c2860-e7e2-41d4-a7dc-8715182ec710 with Priority: HIGHEST for action port [ 653.345851] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.345998] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.346251] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.346337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.346517] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-df3c2860-e7e2-41d4-a7dc-8715182ec710 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.346617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df3c2860-e7e2-41d4-a7dc-8715182ec710" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.346689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df3c2860-e7e2-41d4-a7dc-8715182ec710" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.348084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df3c2860-e7e2-41d4-a7dc-8715182ec710" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.348172] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df3c2860-e7e2-41d4-a7dc-8715182ec710',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.844428] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.844806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.844806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.844879] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.844956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.845642] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.845789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.845856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.846209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.846209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.846478] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 already deleted. [ 653.846478] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.851709] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df3c2860-e7e2-41d4-a7dc-8715182ec710 with status ACTIVE [ 653.851939] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.852161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.852215] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.852742] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.852742] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.852958] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.853073] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.853136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.853295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.853371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.853837] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.853961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.854040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.854187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.854530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.854530] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df3c2860-e7e2-41d4-a7dc-8715182ec710 is going to be updated. [ 653.876620] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.876620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.876620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.876620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.876620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.876620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df3c2860-e7e2-41d4-a7dc-8715182ec710" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.900313] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: SUCCESS [ 653.900313] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.900412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.900692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.900898] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.900971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.901065] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.901254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.901370] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.901485] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.919053] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.920902] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.920902] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.920902] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.920902] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.920902] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.920902] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.920902] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.921333] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.921700] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.922382] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.922534] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.922712] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.922995] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.923202] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.923481] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.945955] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.945955] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 653.945955] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.945955] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.945955] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-19868240-5873-47c0-9579-6a9cb6a66ec2 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.945955] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-19868240-5873-47c0-9579-6a9cb6a66ec2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.945955] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-19868240-5873-47c0-9579-6a9cb6a66ec2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.945955] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-19868240-5873-47c0-9579-6a9cb6a66ec2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.946755] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19868240-5873-47c0-9579-6a9cb6a66ec2',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.406180] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.450553] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.450823] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.450988] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.451433] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.451637] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.451796] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 19868240-5873-47c0-9579-6a9cb6a66ec2 not found, creating... [ 654.452105] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.455274] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.455274] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.455274] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.455274] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.455274] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.455274] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.455274] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.455274] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.455274] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.455274] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 19868240-5873-47c0-9579-6a9cb6a66ec2 is going to be created. [ 654.475640] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.475954] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.475954] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.476562] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.476562] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.477423] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-19868240-5873-47c0-9579-6a9cb6a66ec2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.910249] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.975158] env[71140]: INFO networking_nsxv3.common.synchronization [None req-4566ad6a-c0df-4dfc-9f34-423d798b8e55 None None] Enqueued Resource ID: dbfbef81-dec0-418b-a881-5d04df9fdf76 with Priority: HIGHEST for action port [ 654.975158] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbfbef81-dec0-418b-a881-5d04df9fdf76 with Priority: HIGHEST for action port [ 654.975158] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbfbef81-dec0-418b-a881-5d04df9fdf76 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.975158] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbfbef81-dec0-418b-a881-5d04df9fdf76" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.975158] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbfbef81-dec0-418b-a881-5d04df9fdf76" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.976202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbfbef81-dec0-418b-a881-5d04df9fdf76" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.976400] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbfbef81-dec0-418b-a881-5d04df9fdf76',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.290933] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be in Status: SUCCESS [ 655.291271] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.318798] env[71140]: INFO networking_nsxv3.common.synchronization [None req-61f030a6-46ed-4eb0-a450-c663da6af1e5 tempest-ServersTestFqdnHostnames-630876233 tempest-ServersTestFqdnHostnames-630876233-project-member] Enqueued Resource ID: 55ee773a-5784-4390-9b7c-2b9d4342369e with Priority: HIGHEST for action security_group_rules [ 655.320304] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55ee773a-5784-4390-9b7c-2b9d4342369e with Priority: HIGHEST for action security_group_rules [ 655.320304] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55ee773a-5784-4390-9b7c-2b9d4342369e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.320304] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.320304] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.321054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.321194] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55ee773a-5784-4390-9b7c-2b9d4342369e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.414709] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.414886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.414886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.415070] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.415152] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.416027] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be updated. [ 655.449272] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.449272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.449272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.449272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.449272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.458352] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: IN_PROGRESS for 2s [ 655.481356] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbfbef81-dec0-418b-a881-5d04df9fdf76 [ 655.481356] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.481356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.481356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.481356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.481356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.481356] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbfbef81-dec0-418b-a881-5d04df9fdf76 already deleted. [ 655.481356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbfbef81-dec0-418b-a881-5d04df9fdf76" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.690468] env[71140]: INFO networking_nsxv3.common.synchronization [req-68373af7-f205-42b3-b87a-4f7d6004252a req-6c6e3ade-a216-4d02-b671-c34edd9b8d70 tempest-VolumesAssistedSnapshotsTest-1122912751 tempest-VolumesAssistedSnapshotsTest-1122912751-project-member] Enqueued Resource ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 with Priority: HIGHEST for action security_group_members [ 655.694205] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 with Priority: HIGHEST for action security_group_members [ 655.694205] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1516d35-770d-4ac2-bf00-b0eed6f837f7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.694205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.694205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.694205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.694205] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.694205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.694205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.694205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.694205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.694205] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1516d35-770d-4ac2-bf00-b0eed6f837f7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.769635] env[71140]: INFO networking_nsxv3.common.synchronization [None req-192d9629-d21b-4c31-9b9a-6ac9cef3bbec tempest-ServersTestFqdnHostnames-630876233 tempest-ServersTestFqdnHostnames-630876233-project-member] Enqueued Resource ID: 55ee773a-5784-4390-9b7c-2b9d4342369e with Priority: HIGHEST for action security_group_rules [ 655.770152] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55ee773a-5784-4390-9b7c-2b9d4342369e with Priority: HIGHEST for action security_group_rules [ 655.770555] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55ee773a-5784-4390-9b7c-2b9d4342369e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.770726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.843402] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.843479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.844574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.844574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.846655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.846655] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55ee773a-5784-4390-9b7c-2b9d4342369e already deleted. [ 655.846655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.846655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.846655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.846655] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55ee773a-5784-4390-9b7c-2b9d4342369e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.198673] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.198673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.198673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.198673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.198673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.198673] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.198673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.198673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.198673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.198673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.198673] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 already deleted. [ 656.198673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.300252] env[71140]: INFO networking_nsxv3.common.synchronization [None req-c396d851-ddec-4cc6-b508-2c3361aeb65c None None] Enqueued Resource ID: 7a66374c-79fb-488a-8be9-67e8f2ded5e5 with Priority: HIGHEST for action port [ 656.300252] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a66374c-79fb-488a-8be9-67e8f2ded5e5 with Priority: HIGHEST for action port [ 656.300252] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a66374c-79fb-488a-8be9-67e8f2ded5e5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.300252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a66374c-79fb-488a-8be9-67e8f2ded5e5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.300252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a66374c-79fb-488a-8be9-67e8f2ded5e5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.300252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a66374c-79fb-488a-8be9-67e8f2ded5e5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.300252] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a66374c-79fb-488a-8be9-67e8f2ded5e5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.368529] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.368817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.369077] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.369164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.370770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.370891] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55ee773a-5784-4390-9b7c-2b9d4342369e already deleted. [ 656.371076] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.463770] env[71140]: INFO networking_nsxv3.common.synchronization [None req-a507f0c9-563c-4892-afe0-bb764e2908a0 None None] Enqueued Resource ID: 41cb1f13-8294-44b0-bc7b-6b7b2b295ae9 with Priority: HIGHEST for action port [ 656.466367] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41cb1f13-8294-44b0-bc7b-6b7b2b295ae9 with Priority: HIGHEST for action port [ 656.466428] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-41cb1f13-8294-44b0-bc7b-6b7b2b295ae9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.466551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41cb1f13-8294-44b0-bc7b-6b7b2b295ae9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.466911] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41cb1f13-8294-44b0-bc7b-6b7b2b295ae9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.466989] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41cb1f13-8294-44b0-bc7b-6b7b2b295ae9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.467081] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41cb1f13-8294-44b0-bc7b-6b7b2b295ae9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.685566] env[71140]: INFO networking_nsxv3.common.synchronization [req-649110a5-7f0e-4577-a539-0faf881aeaf8 req-99a504c6-a59d-4197-b91c-54ad7dded9ad service nova] Enqueued Resource ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 with Priority: HIGHEST for action security_group_rules [ 656.685743] env[71140]: INFO networking_nsxv3.common.synchronization [req-649110a5-7f0e-4577-a539-0faf881aeaf8 req-99a504c6-a59d-4197-b91c-54ad7dded9ad service nova] Enqueued Resource ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 with Priority: HIGHEST for action security_group_members [ 656.685911] env[71140]: INFO networking_nsxv3.common.synchronization [req-649110a5-7f0e-4577-a539-0faf881aeaf8 req-99a504c6-a59d-4197-b91c-54ad7dded9ad service nova] Enqueued Resource ID: 19868240-5873-47c0-9579-6a9cb6a66ec2 with Priority: HIGHEST for action port [ 656.686493] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 with Priority: HIGHEST for action security_group_rules [ 656.686741] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 with Priority: HIGHEST for action security_group_members [ 656.686851] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19868240-5873-47c0-9579-6a9cb6a66ec2 with Priority: HIGHEST for action port [ 656.687294] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2accb7b-fbb3-4bd3-a819-611c041bf352 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.687370] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.687370] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.688189] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.688189] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2accb7b-fbb3-4bd3-a819-611c041bf352',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.688882] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2accb7b-fbb3-4bd3-a819-611c041bf352 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.688882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.688882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.689047] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.689145] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.690383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.690383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.690383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.690383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.690383] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2accb7b-fbb3-4bd3-a819-611c041bf352',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.692107] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-19868240-5873-47c0-9579-6a9cb6a66ec2 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.692177] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19868240-5873-47c0-9579-6a9cb6a66ec2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.692209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19868240-5873-47c0-9579-6a9cb6a66ec2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.692765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19868240-5873-47c0-9579-6a9cb6a66ec2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.692765] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19868240-5873-47c0-9579-6a9cb6a66ec2',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.801739] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a66374c-79fb-488a-8be9-67e8f2ded5e5 [ 656.801985] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.802144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.802261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.802482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.802576] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.802819] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a66374c-79fb-488a-8be9-67e8f2ded5e5 already deleted. [ 656.802926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a66374c-79fb-488a-8be9-67e8f2ded5e5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.970902] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41cb1f13-8294-44b0-bc7b-6b7b2b295ae9 [ 656.972496] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.972496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.972496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.972496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.972496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.972496] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41cb1f13-8294-44b0-bc7b-6b7b2b295ae9 already deleted. [ 656.972496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41cb1f13-8294-44b0-bc7b-6b7b2b295ae9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.194539] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2accb7b-fbb3-4bd3-a819-611c041bf352 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.194684] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.197453] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f2accb7b-fbb3-4bd3-a819-611c041bf352',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.198443] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19868240-5873-47c0-9579-6a9cb6a66ec2 with status ACTIVE [ 657.198652] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.198777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.199016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.199086] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.199173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.199339] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.199431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.199474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.199685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.199741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.200796] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.200796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.200796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.200796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.200796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.200796] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19868240-5873-47c0-9579-6a9cb6a66ec2 is going to be updated. [ 657.223119] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.223300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.223357] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.223557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.223702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.223874] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19868240-5873-47c0-9579-6a9cb6a66ec2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.282307] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-802 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.282307] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-802" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.282307] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-802" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.282307] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-802" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.282307] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.282307] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.284821] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.285141] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.285356] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.285727] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 657.286419] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.286419] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.286419] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.286419] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 657.286419] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.286610] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.312368] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.312368] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 657.312368] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.312368] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-802" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.312864] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-bb987fde-0e23-48ad-b8e4-a68472a89680 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.312987] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-bb987fde-0e23-48ad-b8e4-a68472a89680" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.313073] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-bb987fde-0e23-48ad-b8e4-a68472a89680" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.315435] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-bb987fde-0e23-48ad-b8e4-a68472a89680" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.315608] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb987fde-0e23-48ad-b8e4-a68472a89680',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.471101] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: SUCCESS [ 657.471255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.471424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.472708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.472708] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.472708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.472708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.472708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.472708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.472708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.472708] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.474487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.474752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.474981] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.475056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.475126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.475273] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.475353] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.475446] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.703532] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f2accb7b-fbb3-4bd3-a819-611c041bf352',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.821060] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.821060] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.821060] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.821060] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.821060] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.821384] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port bb987fde-0e23-48ad-b8e4-a68472a89680 not found, creating... [ 657.821424] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.821568] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.821690] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.821917] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.822071] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.822383] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.823539] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.823705] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.823959] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.824121] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.824276] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: bb987fde-0e23-48ad-b8e4-a68472a89680 is going to be created. [ 657.845081] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.846070] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.846070] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.846070] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.846070] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.846337] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-bb987fde-0e23-48ad-b8e4-a68472a89680" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.975249] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.975399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.977871] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.209677] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.209677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.209677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.209677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.210116] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.210116] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 is going to be created. [ 658.229323] env[71140]: INFO networking_nsxv3.common.synchronization [req-815f84e2-9fd7-4fa6-aec0-39d07a823ebe req-935fc202-2e1b-41de-b2fd-ba09a7f1b626 tempest-ServerDiagnosticsNegativeTest-1873623418 tempest-ServerDiagnosticsNegativeTest-1873623418-project-member] Enqueued Resource ID: 54bba0b8-b95d-4902-8afe-f2600efb516b with Priority: HIGHEST for action security_group_members [ 658.229841] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54bba0b8-b95d-4902-8afe-f2600efb516b with Priority: HIGHEST for action security_group_members [ 658.229841] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-54bba0b8-b95d-4902-8afe-f2600efb516b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.229841] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.229960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.231075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.231075] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.231075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.231239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.231303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.231426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.231566] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54bba0b8-b95d-4902-8afe-f2600efb516b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.234147] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.234302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.234341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.235665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.237880] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.247727] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 in Status: UNINITIALIZED for 2s [ 658.483967] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.694536] env[71140]: INFO networking_nsxv3.common.synchronization [req-68373af7-f205-42b3-b87a-4f7d6004252a req-41a483a2-c7c2-4ec4-9676-b58d53fe0fb2 service nova] Enqueued Resource ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 with Priority: HIGHEST for action security_group_rules [ 658.694536] env[71140]: INFO networking_nsxv3.common.synchronization [req-68373af7-f205-42b3-b87a-4f7d6004252a req-41a483a2-c7c2-4ec4-9676-b58d53fe0fb2 service nova] Enqueued Resource ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 with Priority: HIGHEST for action security_group_members [ 658.694536] env[71140]: INFO networking_nsxv3.common.synchronization [req-68373af7-f205-42b3-b87a-4f7d6004252a req-41a483a2-c7c2-4ec4-9676-b58d53fe0fb2 service nova] Enqueued Resource ID: bb987fde-0e23-48ad-b8e4-a68472a89680 with Priority: HIGHEST for action port [ 658.694536] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 with Priority: HIGHEST for action security_group_rules [ 658.694536] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 with Priority: HIGHEST for action security_group_members [ 658.694536] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb987fde-0e23-48ad-b8e4-a68472a89680 with Priority: HIGHEST for action port [ 658.694536] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.695047] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.695047] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.695047] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.695199] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1516d35-770d-4ac2-bf00-b0eed6f837f7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.697097] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1516d35-770d-4ac2-bf00-b0eed6f837f7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.697330] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.697402] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.697599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.697816] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.697996] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.698094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.698689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.698689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.698689] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1516d35-770d-4ac2-bf00-b0eed6f837f7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.700425] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb987fde-0e23-48ad-b8e4-a68472a89680 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.700588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb987fde-0e23-48ad-b8e4-a68472a89680" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.700684] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb987fde-0e23-48ad-b8e4-a68472a89680" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.700910] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb987fde-0e23-48ad-b8e4-a68472a89680" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.701695] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb987fde-0e23-48ad-b8e4-a68472a89680',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.734055] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.734217] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.734280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.734485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.734571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.734765] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.734856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.734916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.736073] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.736073] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.736073] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54bba0b8-b95d-4902-8afe-f2600efb516b is going to be updated. [ 658.745888] env[71140]: INFO networking_nsxv3.common.synchronization [req-6d03f452-250d-45ce-b5da-ec41c02d9902 req-21363837-a940-41c7-aa8d-5216a16a28de tempest-ServersAdminNegativeTestJSON-368123288 tempest-ServersAdminNegativeTestJSON-368123288-project-member] Enqueued Resource ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 with Priority: HIGHEST for action security_group_members [ 658.746574] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 with Priority: HIGHEST for action security_group_members [ 658.746938] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-522bdeb8-3be1-4507-b2cc-adc33ff88371 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.747095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.747165] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.747704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.747704] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.747704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.747920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.747920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.748025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.748299] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.762736] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.762736] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.762736] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.762965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.763213] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.771229] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54bba0b8-b95d-4902-8afe-f2600efb516b in Status: IN_PROGRESS for 2s [ 658.988849] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.988849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.988849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.989099] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.989239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.989322] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be updated. [ 659.015687] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.015912] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.016137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.016923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.017141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.028985] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: IN_PROGRESS for 2s [ 659.204295] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1516d35-770d-4ac2-bf00-b0eed6f837f7 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.204295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.206332] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1516d35-770d-4ac2-bf00-b0eed6f837f7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.207327] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb987fde-0e23-48ad-b8e4-a68472a89680 with status ACTIVE [ 659.207530] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.207651] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.207716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.207924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.208032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.208242] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.208466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.208466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.208587] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.209117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.209117] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.209117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.209117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.209117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.209421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.209421] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb987fde-0e23-48ad-b8e4-a68472a89680 is going to be updated. [ 659.250196] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.250819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.250991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.251475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.254025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.254025] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.254025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.254025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.254025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.254025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.254025] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 already deleted. [ 659.254025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.254025] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.254025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.254025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.254025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.254025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.254856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb987fde-0e23-48ad-b8e4-a68472a89680" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.682546] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.682636] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.682717] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.682995] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.683301] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.683410] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.684126] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.684126] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.684126] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.684382] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.684532] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.685375] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.685550] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.685681] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.685847] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.686042] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.708171] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.708171] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 659.708171] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.708171] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.708171] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-effc5d55-833c-4cc1-9d63-454ad67db1cb taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.708171] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-effc5d55-833c-4cc1-9d63-454ad67db1cb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.708171] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-effc5d55-833c-4cc1-9d63-454ad67db1cb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.708171] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-effc5d55-833c-4cc1-9d63-454ad67db1cb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.708171] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('effc5d55-833c-4cc1-9d63-454ad67db1cb',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.712371] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1516d35-770d-4ac2-bf00-b0eed6f837f7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.162818] env[71140]: INFO networking_nsxv3.common.synchronization [None req-c6ecf846-c7e4-44a7-b13d-9082963a442c None None] Enqueued Resource ID: a33075fb-fbb6-4285-8482-fbe99fd06c1d with Priority: HIGHEST for action port [ 660.164808] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a33075fb-fbb6-4285-8482-fbe99fd06c1d with Priority: HIGHEST for action port [ 660.164808] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-a33075fb-fbb6-4285-8482-fbe99fd06c1d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.164808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a33075fb-fbb6-4285-8482-fbe99fd06c1d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.167117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a33075fb-fbb6-4285-8482-fbe99fd06c1d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.167117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a33075fb-fbb6-4285-8482-fbe99fd06c1d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.167117] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a33075fb-fbb6-4285-8482-fbe99fd06c1d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.186131] env[71140]: INFO networking_nsxv3.common.synchronization [None req-dbf78216-9dfb-42a5-a697-9641e26fabf5 None None] Enqueued Resource ID: 31e39959-ce9a-43f9-a3fc-a3e20e3828c3 with Priority: HIGHEST for action port [ 660.186833] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31e39959-ce9a-43f9-a3fc-a3e20e3828c3 with Priority: HIGHEST for action port [ 660.187347] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-31e39959-ce9a-43f9-a3fc-a3e20e3828c3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.187477] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31e39959-ce9a-43f9-a3fc-a3e20e3828c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.189238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31e39959-ce9a-43f9-a3fc-a3e20e3828c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.189238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31e39959-ce9a-43f9-a3fc-a3e20e3828c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.189238] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31e39959-ce9a-43f9-a3fc-a3e20e3828c3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.211016] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.211247] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.211247] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.211535] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.211686] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.212329] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port effc5d55-833c-4cc1-9d63-454ad67db1cb not found, creating... [ 660.212329] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.212329] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.212545] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.213197] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.213452] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.213762] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.213903] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.214046] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.214610] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.215099] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.215303] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: effc5d55-833c-4cc1-9d63-454ad67db1cb is going to be created. [ 660.218751] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.218751] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.218751] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.218751] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.218751] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.218751] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 is going to be created. [ 660.239061] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.239321] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.239514] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.239778] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.240076] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.240345] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-effc5d55-833c-4cc1-9d63-454ad67db1cb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.244023] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.244201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.244265] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.244887] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.244887] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.254267] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 in Status: SUCCESS [ 660.254522] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.254862] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.255118] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.255289] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.255402] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.255467] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.255621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.255714] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.255780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.255891] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f2accb7b-fbb3-4bd3-a819-611c041bf352',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.258072] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 in Status: UNINITIALIZED for 2s [ 660.672034] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a33075fb-fbb6-4285-8482-fbe99fd06c1d [ 660.672034] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.672034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.672034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.672034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.672034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.672515] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a33075fb-fbb6-4285-8482-fbe99fd06c1d already deleted. [ 660.672515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a33075fb-fbb6-4285-8482-fbe99fd06c1d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.690257] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31e39959-ce9a-43f9-a3fc-a3e20e3828c3 [ 660.690257] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.690361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.690361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.690593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.690686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.690795] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31e39959-ce9a-43f9-a3fc-a3e20e3828c3 already deleted. [ 660.690891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31e39959-ce9a-43f9-a3fc-a3e20e3828c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.760480] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2accb7b-fbb3-4bd3-a819-611c041bf352 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.760630] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.760697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.760906] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.761077] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.761176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.761236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.761438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.761524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.764412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.764412] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2accb7b-fbb3-4bd3-a819-611c041bf352 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.764412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.764412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.764412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.764412] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.764412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.764412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.764412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.764412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.764412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.764412] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f2accb7b-fbb3-4bd3-a819-611c041bf352',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.781512] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54bba0b8-b95d-4902-8afe-f2600efb516b in Status: SUCCESS [ 660.781736] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54bba0b8-b95d-4902-8afe-f2600efb516b deletion is rescheduled due to dependency. [ 660.781858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54bba0b8-b95d-4902-8afe-f2600efb516b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.039873] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: SUCCESS [ 661.040107] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.040292] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.040508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.040710] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.040828] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.040895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.041072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.041156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.041241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.041394] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.041574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.041574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.041755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.041896] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.041989] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.042061] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.042199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.042271] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.042352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.042442] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.063635] env[71140]: INFO networking_nsxv3.common.synchronization [req-6d03f452-250d-45ce-b5da-ec41c02d9902 req-87395f0c-b393-4122-af39-98a0eb2c4062 service nova] Enqueued Resource ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 with Priority: HIGHEST for action security_group_rules [ 661.063835] env[71140]: INFO networking_nsxv3.common.synchronization [req-6d03f452-250d-45ce-b5da-ec41c02d9902 req-87395f0c-b393-4122-af39-98a0eb2c4062 service nova] Enqueued Resource ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 with Priority: HIGHEST for action security_group_members [ 661.063955] env[71140]: INFO networking_nsxv3.common.synchronization [req-6d03f452-250d-45ce-b5da-ec41c02d9902 req-87395f0c-b393-4122-af39-98a0eb2c4062 service nova] Enqueued Resource ID: effc5d55-833c-4cc1-9d63-454ad67db1cb with Priority: HIGHEST for action port [ 661.064193] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 with Priority: HIGHEST for action security_group_rules [ 661.064325] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 with Priority: HIGHEST for action security_group_members [ 661.064417] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: effc5d55-833c-4cc1-9d63-454ad67db1cb with Priority: HIGHEST for action port [ 661.064926] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-522bdeb8-3be1-4507-b2cc-adc33ff88371 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.065271] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.065385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.065603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.065713] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.068567] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-522bdeb8-3be1-4507-b2cc-adc33ff88371 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.068567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.068567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.068567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.068567] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.068567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.068567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.068567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.068567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.068567] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.069738] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-effc5d55-833c-4cc1-9d63-454ad67db1cb taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.069738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-effc5d55-833c-4cc1-9d63-454ad67db1cb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.069738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-effc5d55-833c-4cc1-9d63-454ad67db1cb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.069943] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-effc5d55-833c-4cc1-9d63-454ad67db1cb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.069943] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('effc5d55-833c-4cc1-9d63-454ad67db1cb',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.267914] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f2accb7b-fbb3-4bd3-a819-611c041bf352: rpc.has_security_group_logging(os_id): False [ 661.286152] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.286366] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.286445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.286681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.286735] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.287110] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.287172] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.287208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.287378] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.287433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.287616] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.287710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.287772] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.288085] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.288085] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.288183] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.288331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.288331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.288472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.288559] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.288718] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 is going to be created. [ 661.341741] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.342060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.342060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.342278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.342388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.355953] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 in Status: IN_PROGRESS for 2s [ 661.548403] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 184bb91c-9526-466a-820b-ced20908d98e: rpc.has_security_group_logging(os_id): False [ 661.569028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.569028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.569028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.569028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.569028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.569028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.569028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.569028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.569028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.569028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.569028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.569028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.569028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.569630] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.569630] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.569630] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.569630] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.569630] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.570145] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.570418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.570608] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be created. [ 661.572522] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-522bdeb8-3be1-4507-b2cc-adc33ff88371 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.573497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.579815] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port effc5d55-833c-4cc1-9d63-454ad67db1cb with status ACTIVE [ 661.580096] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.580251] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.580251] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.580426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.580488] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.580624] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.580716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.580775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.580996] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.581068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.581205] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.581321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.581355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.581493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.581584] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.581645] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: effc5d55-833c-4cc1-9d63-454ad67db1cb is going to be updated. [ 661.582669] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.600435] env[71140]: INFO networking_nsxv3.common.synchronization [None req-2324df49-e661-4b69-97d7-9ba7eeccbd53 tempest-ServerActionsTestOtherB-2025667431 tempest-ServerActionsTestOtherB-2025667431-project-member] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_rules [ 661.600905] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_rules [ 661.604130] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.604130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.604130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.604130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.604130] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.604426] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.604426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.604556] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.604672] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.604824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.604965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-effc5d55-833c-4cc1-9d63-454ad67db1cb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.643571] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.643859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.643926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.644153] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.644392] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.667194] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: IN_PROGRESS for 2s [ 661.735481] env[71140]: INFO networking_nsxv3.common.synchronization [None req-d03a911e-4ce7-49b4-9e6a-cd25c2cc9eef tempest-ServerActionsTestOtherB-2025667431 tempest-ServerActionsTestOtherB-2025667431-project-member] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_rules [ 661.736490] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_rules [ 661.738327] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.738327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.991057] env[71140]: INFO networking_nsxv3.common.synchronization [None req-be40c96a-fe03-41b8-9246-4520ebce5e6a None None] Enqueued Resource ID: 4e5a835c-bef3-4595-b936-9baefd146d18 with Priority: HIGHEST for action port [ 661.991057] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e5a835c-bef3-4595-b936-9baefd146d18 with Priority: HIGHEST for action port [ 661.991057] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e5a835c-bef3-4595-b936-9baefd146d18 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.991057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e5a835c-bef3-4595-b936-9baefd146d18" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.991057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e5a835c-bef3-4595-b936-9baefd146d18" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.991057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e5a835c-bef3-4595-b936-9baefd146d18" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.991896] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e5a835c-bef3-4595-b936-9baefd146d18',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.086978] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.121629] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.121834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.121834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.122197] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.122197] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.122299] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c already deleted. [ 662.122354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.122771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.123011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.123112] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.268675] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 in Status: SUCCESS [ 662.269073] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.269148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.269545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.269660] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.269771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.269834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.270017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.270112] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.270192] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.270284] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1516d35-770d-4ac2-bf00-b0eed6f837f7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.494118] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e5a835c-bef3-4595-b936-9baefd146d18 [ 662.494369] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.494507] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.495683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.495683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.495683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.495683] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e5a835c-bef3-4595-b936-9baefd146d18 already deleted. [ 662.495683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e5a835c-bef3-4595-b936-9baefd146d18" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.589521] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.589675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.589745] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.589956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.591220] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.591220] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 is going to be created. [ 662.613227] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.613227] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.613227] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.613490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.614505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.628243] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 in Status: UNINITIALIZED for 2s [ 662.646351] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.646519] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.646590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.647225] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.647225] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.647225] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c already deleted. [ 662.647225] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.776693] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1516d35-770d-4ac2-bf00-b0eed6f837f7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.283165] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1516d35-770d-4ac2-bf00-b0eed6f837f7: rpc.has_security_group_logging(os_id): False [ 663.301311] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.301311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.301311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.301311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.301311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.301311] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.301311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.301311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.301311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.301311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.301311] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 is going to be created. [ 663.363610] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.363801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.364050] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.364112] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.364468] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.368824] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 in Status: SUCCESS [ 663.368824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.375548] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 in Status: IN_PROGRESS for 2s [ 663.681100] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: SUCCESS [ 663.683811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.683811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.683811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.683811] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.730051] env[71140]: INFO networking_nsxv3.common.synchronization [req-f95a35c0-fd69-4901-87d4-6c047a8c3a83 req-8bb05aec-c580-4de9-86f4-f2d2c6bd9c58 tempest-ServerExternalEventsTest-516530908 tempest-ServerExternalEventsTest-516530908-project-member] Enqueued Resource ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be with Priority: HIGHEST for action security_group_members [ 663.730602] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be with Priority: HIGHEST for action security_group_members [ 663.731250] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.731250] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.731250] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.731440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.731636] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.731740] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.731801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.731960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.733052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.734471] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fa22f34-dd54-4c36-9be4-89ad63b6e1be',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.188187] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.188390] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.188471] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.188639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.188807] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.188902] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.188964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.189122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.189208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.189295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.189383] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.235804] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.236051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.236137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.236434] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.236572] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.236808] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.236923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.236923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.237705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.237785] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.237901] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be is going to be updated. [ 664.269188] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.269188] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.269188] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.269188] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.269188] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.282591] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be in Status: IN_PROGRESS for 2s [ 664.639314] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 in Status: SUCCESS [ 664.639624] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.639705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.639934] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.640142] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.640262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.640324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.640475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.640554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.640638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.640725] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.693938] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.696784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.696784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.696784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.698489] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.698489] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.698489] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.698489] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.698489] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.698773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.699755] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.699755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.700161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.700161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.700161] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.703555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.703555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.703555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.703555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.703555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.703555] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.746638] env[71140]: INFO networking_nsxv3.common.synchronization [None req-7b513cbb-091b-4d45-a652-8524d4024c71 None None] Enqueued Resource ID: 6dce36c1-7d2e-4939-a80f-f6af6fbc3271 with Priority: HIGHEST for action port [ 664.747358] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dce36c1-7d2e-4939-a80f-f6af6fbc3271 with Priority: HIGHEST for action port [ 664.747573] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dce36c1-7d2e-4939-a80f-f6af6fbc3271 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.747735] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dce36c1-7d2e-4939-a80f-f6af6fbc3271" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.747836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dce36c1-7d2e-4939-a80f-f6af6fbc3271" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.748180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dce36c1-7d2e-4939-a80f-f6af6fbc3271" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.748268] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dce36c1-7d2e-4939-a80f-f6af6fbc3271',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.980258] env[71140]: INFO networking_nsxv3.common.synchronization [req-c231eed6-fbf6-4d89-a701-60b255327ecf req-2f6a0c81-0c30-4811-b775-a9d01cfdc12b tempest-ServerMetadataTestJSON-1889177665 tempest-ServerMetadataTestJSON-1889177665-project-member] Enqueued Resource ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 with Priority: HIGHEST for action security_group_members [ 664.981096] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 with Priority: HIGHEST for action security_group_members [ 664.981241] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-622a5b07-14ae-44ec-94dd-57b4349034a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.981363] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.981429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.981681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.981852] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.981946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.982015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.984019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.984019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.984019] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('622a5b07-14ae-44ec-94dd-57b4349034a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.149632] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-522bdeb8-3be1-4507-b2cc-adc33ff88371 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.149632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.149632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.149632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.149632] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.149632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.149632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.149632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.149632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.149632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.149632] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-522bdeb8-3be1-4507-b2cc-adc33ff88371 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.149632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.149632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.149632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.150209] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.150209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.150209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.150209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.150209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.150209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.150209] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.205047] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 184bb91c-9526-466a-820b-ced20908d98e: rpc.has_security_group_logging(os_id): False [ 665.225373] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.225563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.225618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.226040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.226040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.226318] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.226318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.226483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.226544] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.226634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.226925] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.226925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.227073] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.227176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.227257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.227450] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.227531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.227599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.228299] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.228299] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.228299] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be updated. [ 665.254229] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6dce36c1-7d2e-4939-a80f-f6af6fbc3271 [ 665.254229] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.254229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.254229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.254229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.254229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.254229] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6dce36c1-7d2e-4939-a80f-f6af6fbc3271 already deleted. [ 665.254229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dce36c1-7d2e-4939-a80f-f6af6fbc3271" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.296241] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.296413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.296472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.296948] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.296948] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.311138] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: IN_PROGRESS for 2s [ 665.391913] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 in Status: SUCCESS [ 665.392756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.490218] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.490405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.490505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.490736] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.490848] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.491502] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.491502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.491502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.491502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.491706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.491706] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 already deleted. [ 665.491790] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.652836] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 522bdeb8-3be1-4507-b2cc-adc33ff88371: rpc.has_security_group_logging(os_id): False [ 665.671056] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.671358] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.671358] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.671592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.671700] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.671813] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.671916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.672044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.672314] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.672374] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.672566] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.672680] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.672757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.672898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.672966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.675491] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.675605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.675605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.675789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.675937] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.676089] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 is going to be created. [ 665.742652] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.743025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.743148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.743344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.743555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.764418] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.764914] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-916" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.765168] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-916" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.765648] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-916" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.766331] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.766445] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.766636] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.766898] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.767140] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.767477] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.767669] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.767845] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.768747] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.769045] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.769304] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.769612] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.772078] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 in Status: IN_PROGRESS for 2s [ 665.793088] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.793088] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 665.793088] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.793088] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-916" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.793088] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-152d0b51-90c2-4cbf-b1db-bb2e7cdb8648 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.793088] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-152d0b51-90c2-4cbf-b1db-bb2e7cdb8648" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.793088] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-152d0b51-90c2-4cbf-b1db-bb2e7cdb8648" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.793088] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-152d0b51-90c2-4cbf-b1db-bb2e7cdb8648" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.793620] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('152d0b51-90c2-4cbf-b1db-bb2e7cdb8648',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.292450] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be in Status: SUCCESS [ 666.292656] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be deletion is rescheduled due to dependency. [ 666.293218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.297613] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.298043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.298043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.298349] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.298527] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.298679] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 152d0b51-90c2-4cbf-b1db-bb2e7cdb8648 not found, creating... [ 666.298963] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.299166] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.299298] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.299558] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.299752] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.299996] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.302059] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.302298] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.302806] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.302991] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.303246] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 152d0b51-90c2-4cbf-b1db-bb2e7cdb8648 is going to be created. [ 666.322205] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.322608] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.322708] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.322956] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.323271] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.324033] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-152d0b51-90c2-4cbf-b1db-bb2e7cdb8648" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.324768] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: SUCCESS [ 667.325140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.332671] env[71140]: INFO networking_nsxv3.common.synchronization [req-c231eed6-fbf6-4d89-a701-60b255327ecf req-78668104-d5b7-4161-8d55-a5a17ec50749 service nova] Enqueued Resource ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 with Priority: HIGHEST for action security_group_rules [ 667.332864] env[71140]: INFO networking_nsxv3.common.synchronization [req-c231eed6-fbf6-4d89-a701-60b255327ecf req-78668104-d5b7-4161-8d55-a5a17ec50749 service nova] Enqueued Resource ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 with Priority: HIGHEST for action security_group_members [ 667.332993] env[71140]: INFO networking_nsxv3.common.synchronization [req-c231eed6-fbf6-4d89-a701-60b255327ecf req-78668104-d5b7-4161-8d55-a5a17ec50749 service nova] Enqueued Resource ID: 152d0b51-90c2-4cbf-b1db-bb2e7cdb8648 with Priority: HIGHEST for action port [ 667.333334] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 with Priority: HIGHEST for action security_group_rules [ 667.333409] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 with Priority: HIGHEST for action security_group_members [ 667.333638] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152d0b51-90c2-4cbf-b1db-bb2e7cdb8648 with Priority: HIGHEST for action port [ 667.336152] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-622a5b07-14ae-44ec-94dd-57b4349034a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.336331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.336406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.336673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.336832] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('622a5b07-14ae-44ec-94dd-57b4349034a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.339790] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-622a5b07-14ae-44ec-94dd-57b4349034a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.339790] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.339790] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.340105] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.340202] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.340326] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.340640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.340945] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.341145] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.341252] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('622a5b07-14ae-44ec-94dd-57b4349034a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.343476] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-152d0b51-90c2-4cbf-b1db-bb2e7cdb8648 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.343476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-152d0b51-90c2-4cbf-b1db-bb2e7cdb8648" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.343476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-152d0b51-90c2-4cbf-b1db-bb2e7cdb8648" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.343476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-152d0b51-90c2-4cbf-b1db-bb2e7cdb8648" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.343476] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('152d0b51-90c2-4cbf-b1db-bb2e7cdb8648',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.411487] env[71140]: INFO networking_nsxv3.common.synchronization [req-0c3cd2fa-9267-4512-bfbc-8a6827a8dcbf req-ad64b52d-0d4a-4e2b-bfa5-258526a8c322 tempest-ServersWithSpecificFlavorTestJSON-1339181312 tempest-ServersWithSpecificFlavorTestJSON-1339181312-project-member] Enqueued Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_members [ 667.412170] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_members [ 667.412476] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62a92b8-4863-4e9d-809d-e8687b429f2a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.413036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.413036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.413036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.413264] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.413391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.413474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.413666] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.413754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.413850] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.783198] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 in Status: SUCCESS [ 667.783442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.843335] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-622a5b07-14ae-44ec-94dd-57b4349034a7 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.843335] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.843335] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('622a5b07-14ae-44ec-94dd-57b4349034a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.847187] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 152d0b51-90c2-4cbf-b1db-bb2e7cdb8648 with status ACTIVE [ 667.847416] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.847548] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.847617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.847835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.847950] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.848117] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.848284] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.848352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.848528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.848710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.849627] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.849627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.849627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.849627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.849627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.849627] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 152d0b51-90c2-4cbf-b1db-bb2e7cdb8648 is going to be updated. [ 667.868905] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.869141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.869141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.869376] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.869510] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.869685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-152d0b51-90c2-4cbf-b1db-bb2e7cdb8648" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.916727] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.916727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.916942] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.917063] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.917142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.917344] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.917461] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.917516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.917667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.917754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.917816] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c62a92b8-4863-4e9d-809d-e8687b429f2a already deleted. [ 667.917894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.063099] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.063275] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-354" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.063397] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-354" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.063723] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-354" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.063990] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.064161] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.064277] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.064491] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.064635] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.064841] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 668.064952] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.065073] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.065180] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.065287] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 668.065389] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.065521] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.082736] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.083118] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 668.083118] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.083292] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-354" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.083615] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-94ae3c07-8503-40e1-882a-d42aa21be01a taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.083794] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-94ae3c07-8503-40e1-882a-d42aa21be01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.083956] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-94ae3c07-8503-40e1-882a-d42aa21be01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.084302] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-94ae3c07-8503-40e1-882a-d42aa21be01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.085414] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94ae3c07-8503-40e1-882a-d42aa21be01a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.346301] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('622a5b07-14ae-44ec-94dd-57b4349034a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.588671] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.588924] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.589311] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.589637] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.589813] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.589969] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 94ae3c07-8503-40e1-882a-d42aa21be01a not found, creating... [ 668.597024] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.597024] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.597024] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.597024] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.597024] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.597024] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.597024] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.597024] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.597024] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.597619] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.597619] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 94ae3c07-8503-40e1-882a-d42aa21be01a is going to be created. [ 668.612745] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.613205] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.613847] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.614666] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.614931] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.615195] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-94ae3c07-8503-40e1-882a-d42aa21be01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.851499] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.851692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.851764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.851974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.852073] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.853018] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 is going to be created. [ 668.879071] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.879071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.879411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.879411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.880210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.890181] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 in Status: UNINITIALIZED for 2s [ 668.956133] env[71140]: INFO networking_nsxv3.common.synchronization [None req-12e3546f-9d6f-442d-8d58-2a6107756e6c None None] Enqueued Resource ID: 847d3904-877f-465d-aa51-96b4e604e81b with Priority: HIGHEST for action port [ 668.956133] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 847d3904-877f-465d-aa51-96b4e604e81b with Priority: HIGHEST for action port [ 668.956133] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-847d3904-877f-465d-aa51-96b4e604e81b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.956133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-847d3904-877f-465d-aa51-96b4e604e81b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.956133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-847d3904-877f-465d-aa51-96b4e604e81b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.956612] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-847d3904-877f-465d-aa51-96b4e604e81b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.956811] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('847d3904-877f-465d-aa51-96b4e604e81b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.461442] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 847d3904-877f-465d-aa51-96b4e604e81b [ 669.461442] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.461442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.461442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.461442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.461442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.461442] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:847d3904-877f-465d-aa51-96b4e604e81b already deleted. [ 669.461442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-847d3904-877f-465d-aa51-96b4e604e81b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.685026] env[71140]: INFO networking_nsxv3.common.synchronization [req-0c3cd2fa-9267-4512-bfbc-8a6827a8dcbf req-12d72fe8-8f8a-4fd5-8ede-8dcd70618f05 service nova] Enqueued Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_rules [ 669.685026] env[71140]: INFO networking_nsxv3.common.synchronization [req-0c3cd2fa-9267-4512-bfbc-8a6827a8dcbf req-12d72fe8-8f8a-4fd5-8ede-8dcd70618f05 service nova] Enqueued Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_members [ 669.685026] env[71140]: INFO networking_nsxv3.common.synchronization [req-0c3cd2fa-9267-4512-bfbc-8a6827a8dcbf req-12d72fe8-8f8a-4fd5-8ede-8dcd70618f05 service nova] Enqueued Resource ID: 94ae3c07-8503-40e1-882a-d42aa21be01a with Priority: HIGHEST for action port [ 669.685026] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_rules [ 669.685026] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_members [ 669.685026] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ae3c07-8503-40e1-882a-d42aa21be01a with Priority: HIGHEST for action port [ 669.685903] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c62a92b8-4863-4e9d-809d-e8687b429f2a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.686236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.686598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.686919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.687163] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.688312] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62a92b8-4863-4e9d-809d-e8687b429f2a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.690187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.690187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.690187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.690187] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.690187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.690187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.690187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.690187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.690187] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.691976] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-94ae3c07-8503-40e1-882a-d42aa21be01a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.691976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94ae3c07-8503-40e1-882a-d42aa21be01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.691976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94ae3c07-8503-40e1-882a-d42aa21be01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.692384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94ae3c07-8503-40e1-882a-d42aa21be01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.693678] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94ae3c07-8503-40e1-882a-d42aa21be01a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.196688] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62a92b8-4863-4e9d-809d-e8687b429f2a taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.197148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.204198] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94ae3c07-8503-40e1-882a-d42aa21be01a with status ACTIVE [ 670.204198] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.204198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.204198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.204198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.204198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.204198] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.204198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.204198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.204198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.204198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.204198] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.204198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.204198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.204198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.205710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.205710] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94ae3c07-8503-40e1-882a-d42aa21be01a is going to be updated. [ 670.205710] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.227069] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.227069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.227069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.227069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.227632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.227632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94ae3c07-8503-40e1-882a-d42aa21be01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.650124] env[71140]: INFO networking_nsxv3.common.synchronization [req-e49dbebc-8b2a-40e8-b59b-8bc120e7ff65 req-20fa57a3-ac05-404f-86e2-2d3bd8049b2c tempest-TenantUsagesTestJSON-604056561 tempest-TenantUsagesTestJSON-604056561-project-member] Enqueued Resource ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca with Priority: HIGHEST for action security_group_members [ 670.650769] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca with Priority: HIGHEST for action security_group_members [ 670.650993] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.651135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.651204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.651470] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.651634] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.651737] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.651820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.651949] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.655140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.655314] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93e058db-48b8-4fa6-b206-7dbbf9ae47ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.706059] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.905465] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 in Status: SUCCESS [ 670.905465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.905465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.905465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.905465] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.905465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.905465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.905465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.905465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.905465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.905465] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('622a5b07-14ae-44ec-94dd-57b4349034a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.157761] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.157934] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.157934] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.158208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.158303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.158498] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.158629] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.158696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.158854] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.158930] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.159025] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca already deleted. [ 671.159127] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.204504] env[71140]: INFO networking_nsxv3.common.synchronization [None req-875b62bd-0441-47dd-8519-cde32e5154fa None None] Enqueued Resource ID: 92fc1a6f-6148-4549-8375-53e692a0b05b with Priority: HIGHEST for action port [ 671.205056] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92fc1a6f-6148-4549-8375-53e692a0b05b with Priority: HIGHEST for action port [ 671.205383] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-92fc1a6f-6148-4549-8375-53e692a0b05b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.205503] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92fc1a6f-6148-4549-8375-53e692a0b05b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.205565] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92fc1a6f-6148-4549-8375-53e692a0b05b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.205818] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92fc1a6f-6148-4549-8375-53e692a0b05b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.205899] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92fc1a6f-6148-4549-8375-53e692a0b05b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.210726] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.210726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.210726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.210726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.210726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.210726] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c62a92b8-4863-4e9d-809d-e8687b429f2a is going to be created. [ 671.234366] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.234543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.234615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.234832] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.234993] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.244356] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62a92b8-4863-4e9d-809d-e8687b429f2a in Status: UNINITIALIZED for 2s [ 671.409575] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-622a5b07-14ae-44ec-94dd-57b4349034a7 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.409732] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.409732] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.409967] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.410138] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.410233] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.410296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.410446] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.410528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.410612] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.410783] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-622a5b07-14ae-44ec-94dd-57b4349034a7 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.410874] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.410939] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.411098] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.411231] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.411960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.411960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.411960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.411960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.411960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.411960] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('622a5b07-14ae-44ec-94dd-57b4349034a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.413375] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.416018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.416018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.416018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.416018] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.416018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.416018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.416018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.416018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.416018] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.416018] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.416018] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.416018] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.416018] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.416018] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.417565] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.435913] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.436709] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 671.436709] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.436942] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.439083] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-6b2c7d51-a251-447c-83ef-53478a22fda6 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.439083] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-6b2c7d51-a251-447c-83ef-53478a22fda6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.439083] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-6b2c7d51-a251-447c-83ef-53478a22fda6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.439083] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-6b2c7d51-a251-447c-83ef-53478a22fda6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.439083] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b2c7d51-a251-447c-83ef-53478a22fda6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.708019] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92fc1a6f-6148-4549-8375-53e692a0b05b [ 671.708321] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.708399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.708460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.708683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.708795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.708871] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92fc1a6f-6148-4549-8375-53e692a0b05b already deleted. [ 671.708954] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92fc1a6f-6148-4549-8375-53e692a0b05b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.921416] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 622a5b07-14ae-44ec-94dd-57b4349034a7: rpc.has_security_group_logging(os_id): False [ 671.938639] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.938773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.938842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.939076] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.939168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.939410] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.939474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.939539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.939748] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.939789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.939936] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.940040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.940101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.940243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.940308] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.940557] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.940692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.940692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.940789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.940835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.941037] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 is going to be created. [ 671.946534] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.946656] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.946793] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.947074] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.947238] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.947366] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 6b2c7d51-a251-447c-83ef-53478a22fda6 not found, creating... [ 671.947616] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.947788] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.947914] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.948141] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.948274] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.948582] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.948733] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.948901] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.949078] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.949257] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.949342] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 6b2c7d51-a251-447c-83ef-53478a22fda6 is going to be created. [ 671.980681] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.980973] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.981129] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.981436] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.981759] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.982139] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-6b2c7d51-a251-447c-83ef-53478a22fda6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.014270] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.014440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.014510] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.015999] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.016243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.028047] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 in Status: IN_PROGRESS for 2s [ 672.123783] env[71140]: INFO networking_nsxv3.common.synchronization [None req-6b8a6761-5430-4956-a11e-3697813ded4c tempest-ServersTestManualDisk-1307284355 tempest-ServersTestManualDisk-1307284355-project-member] Enqueued Resource ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 with Priority: HIGHEST for action security_group_rules [ 672.123783] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 with Priority: HIGHEST for action security_group_rules [ 672.123783] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-604d5290-2f79-4d99-b6f1-1e0335d615a9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.123783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.123783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.125435] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.126394] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('604d5290-2f79-4d99-b6f1-1e0335d615a9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.476859] env[71140]: INFO networking_nsxv3.common.synchronization [req-78986c60-bfb7-47ba-a037-5686ec5a0c01 req-21f2f080-2c50-4a13-9d2a-825fdab81bf6 tempest-ServerDiagnosticsTest-1196517979 tempest-ServerDiagnosticsTest-1196517979-project-member] Enqueued Resource ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 with Priority: HIGHEST for action security_group_members [ 672.479383] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 with Priority: HIGHEST for action security_group_members [ 672.479620] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2accb7b-fbb3-4bd3-a819-611c041bf352 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.481549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.481549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.481549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.481549] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.483909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.483909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.483909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.483909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.483909] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2accb7b-fbb3-4bd3-a819-611c041bf352',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.510088] env[71140]: INFO networking_nsxv3.common.synchronization [None req-1039eee5-0b8b-4693-9450-e485784f496f tempest-ServersTestManualDisk-1307284355 tempest-ServersTestManualDisk-1307284355-project-member] Enqueued Resource ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 with Priority: HIGHEST for action security_group_rules [ 672.510932] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 with Priority: HIGHEST for action security_group_rules [ 672.510932] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-604d5290-2f79-4d99-b6f1-1e0335d615a9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.511096] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.654155] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.654155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.654155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.654155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.654715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.654871] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 already deleted. [ 672.654981] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.656330] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.656330] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.656330] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('604d5290-2f79-4d99-b6f1-1e0335d615a9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.901411] env[71140]: INFO networking_nsxv3.common.synchronization [req-c8be3741-bbdc-40d5-8bf9-c7929ad04674 req-5f65185d-bf74-443a-bde2-8cc88a853f38 tempest-VolumesAdminNegativeTest-302320000 tempest-VolumesAdminNegativeTest-302320000-project-member] Enqueued Resource ID: bc92ef18-2831-4b38-acbe-82e66080661f with Priority: HIGHEST for action security_group_members [ 672.901411] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc92ef18-2831-4b38-acbe-82e66080661f with Priority: HIGHEST for action security_group_members [ 672.901411] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc92ef18-2831-4b38-acbe-82e66080661f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.901411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.901411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.901411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.901411] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.901411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.901411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.901411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.901411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.901411] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc92ef18-2831-4b38-acbe-82e66080661f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.987260] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.987424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.987474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.987698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.987796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.991033] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.991033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.991033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.991033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.991033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.991033] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 is going to be updated. [ 673.016276] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.016372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.016464] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.016675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.016819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.026996] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 in Status: IN_PROGRESS for 2s [ 673.205684] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.205800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.205893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.206198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.206296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.206412] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 already deleted. [ 673.206494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.227221] env[71140]: INFO networking_nsxv3.common.synchronization [req-e49dbebc-8b2a-40e8-b59b-8bc120e7ff65 req-fb3894c7-3021-4ded-b62f-14175f5dd0e2 service nova] Enqueued Resource ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca with Priority: HIGHEST for action security_group_rules [ 673.227424] env[71140]: INFO networking_nsxv3.common.synchronization [req-e49dbebc-8b2a-40e8-b59b-8bc120e7ff65 req-fb3894c7-3021-4ded-b62f-14175f5dd0e2 service nova] Enqueued Resource ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca with Priority: HIGHEST for action security_group_members [ 673.227567] env[71140]: INFO networking_nsxv3.common.synchronization [req-e49dbebc-8b2a-40e8-b59b-8bc120e7ff65 req-fb3894c7-3021-4ded-b62f-14175f5dd0e2 service nova] Enqueued Resource ID: 6b2c7d51-a251-447c-83ef-53478a22fda6 with Priority: HIGHEST for action port [ 673.227811] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca with Priority: HIGHEST for action security_group_rules [ 673.227938] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca with Priority: HIGHEST for action security_group_members [ 673.228046] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b2c7d51-a251-447c-83ef-53478a22fda6 with Priority: HIGHEST for action port [ 673.228702] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93e058db-48b8-4fa6-b206-7dbbf9ae47ca taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.228842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.228842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.229103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.229175] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93e058db-48b8-4fa6-b206-7dbbf9ae47ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.230095] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.230233] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.230297] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.230470] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.230619] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.230709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.230767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.230964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.231033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.231266] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93e058db-48b8-4fa6-b206-7dbbf9ae47ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.232581] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b2c7d51-a251-447c-83ef-53478a22fda6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.232581] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b2c7d51-a251-447c-83ef-53478a22fda6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.232581] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b2c7d51-a251-447c-83ef-53478a22fda6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.232581] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b2c7d51-a251-447c-83ef-53478a22fda6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.232581] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b2c7d51-a251-447c-83ef-53478a22fda6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.255627] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62a92b8-4863-4e9d-809d-e8687b429f2a in Status: SUCCESS [ 673.255850] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.256046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.256409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.256495] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.256564] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.256608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.256757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.256831] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.256916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.257017] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.407874] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.408017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.408112] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.408308] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.408412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.408611] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.408707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.408767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.408920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.409070] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.409129] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc92ef18-2831-4b38-acbe-82e66080661f already deleted. [ 673.409178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.411103] env[71140]: INFO networking_nsxv3.common.synchronization [None req-4daf5eaa-d2ec-4cbf-9e65-55ea8ffde44e None None] Enqueued Resource ID: 19973dce-8856-47d9-8488-3728a7dfd9c1 with Priority: HIGHEST for action port [ 673.412370] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19973dce-8856-47d9-8488-3728a7dfd9c1 with Priority: HIGHEST for action port [ 673.412683] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-19973dce-8856-47d9-8488-3728a7dfd9c1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.412801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19973dce-8856-47d9-8488-3728a7dfd9c1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.412964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19973dce-8856-47d9-8488-3728a7dfd9c1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.413306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19973dce-8856-47d9-8488-3728a7dfd9c1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.413306] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19973dce-8856-47d9-8488-3728a7dfd9c1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.461091] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-685 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.461091] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-685" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.461091] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-685" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.461091] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-685" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.461091] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.461091] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.461091] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.461091] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.461091] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.461091] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 673.463364] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 673.463657] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 673.463931] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 673.464848] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 673.464848] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 673.464848] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 673.486492] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 673.486600] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 673.486640] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 673.487111] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-685" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.487247] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-14ca4bda-55ad-4a99-bcfb-fc7a64bffa01 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.487752] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-14ca4bda-55ad-4a99-bcfb-fc7a64bffa01" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.487752] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-14ca4bda-55ad-4a99-bcfb-fc7a64bffa01" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.487828] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-14ca4bda-55ad-4a99-bcfb-fc7a64bffa01" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.488807] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14ca4bda-55ad-4a99-bcfb-fc7a64bffa01',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.737020] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93e058db-48b8-4fa6-b206-7dbbf9ae47ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.737020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.737020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.737020] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b2c7d51-a251-447c-83ef-53478a22fda6 with status ACTIVE [ 673.737020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.737020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.737020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.737020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.737020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.737020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.737020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.737020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.738269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.738498] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.738831] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.739080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.739793] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.742529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.742529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.742529] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b2c7d51-a251-447c-83ef-53478a22fda6 is going to be updated. [ 673.759095] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.766617] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.766795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.766873] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.767147] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.767278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.767436] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b2c7d51-a251-447c-83ef-53478a22fda6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.916510] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19973dce-8856-47d9-8488-3728a7dfd9c1 [ 673.916859] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.917702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.917702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.917702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.917702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.917702] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19973dce-8856-47d9-8488-3728a7dfd9c1 already deleted. [ 673.917702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19973dce-8856-47d9-8488-3728a7dfd9c1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.995495] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.995495] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.995495] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.995495] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.995495] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.995495] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 14ca4bda-55ad-4a99-bcfb-fc7a64bffa01 not found, creating... [ 673.995495] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.995495] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.995495] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.995495] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.996038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.996038] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.996038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.996038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.996038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.996038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.996038] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 14ca4bda-55ad-4a99-bcfb-fc7a64bffa01 is going to be created. [ 674.016792] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.018667] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.018667] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.018667] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.018667] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.018667] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-14ca4bda-55ad-4a99-bcfb-fc7a64bffa01" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.040219] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 in Status: SUCCESS [ 674.040219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.244074] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93e058db-48b8-4fa6-b206-7dbbf9ae47ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.268688] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c62a92b8-4863-4e9d-809d-e8687b429f2a: rpc.has_security_group_logging(os_id): False [ 674.289246] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.289464] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.289569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.289874] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.289949] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.291723] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.291869] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.291972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.292208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.292401] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.292464] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c62a92b8-4863-4e9d-809d-e8687b429f2a is going to be created. [ 674.351399] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.351399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.351399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.352675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.353053] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.366337] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c62a92b8-4863-4e9d-809d-e8687b429f2a in Status: IN_PROGRESS for 2s [ 674.748655] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.748927] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.749061] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.749388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.749539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.749684] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca is going to be created. [ 674.777693] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.777693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.777693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.777941] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.777941] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.788149] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca in Status: UNINITIALIZED for 2s [ 675.038906] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 in Status: SUCCESS [ 675.038906] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 deletion is rescheduled due to dependency. [ 675.038906] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.264436] env[71140]: INFO networking_nsxv3.common.synchronization [req-c8be3741-bbdc-40d5-8bf9-c7929ad04674 req-992391c6-62ff-4da6-a925-8d1eac634aca service nova] Enqueued Resource ID: bc92ef18-2831-4b38-acbe-82e66080661f with Priority: HIGHEST for action security_group_rules [ 675.264670] env[71140]: INFO networking_nsxv3.common.synchronization [req-c8be3741-bbdc-40d5-8bf9-c7929ad04674 req-992391c6-62ff-4da6-a925-8d1eac634aca service nova] Enqueued Resource ID: bc92ef18-2831-4b38-acbe-82e66080661f with Priority: HIGHEST for action security_group_members [ 675.264819] env[71140]: INFO networking_nsxv3.common.synchronization [req-c8be3741-bbdc-40d5-8bf9-c7929ad04674 req-992391c6-62ff-4da6-a925-8d1eac634aca service nova] Enqueued Resource ID: 14ca4bda-55ad-4a99-bcfb-fc7a64bffa01 with Priority: HIGHEST for action port [ 675.265359] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc92ef18-2831-4b38-acbe-82e66080661f with Priority: HIGHEST for action security_group_rules [ 675.265476] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc92ef18-2831-4b38-acbe-82e66080661f with Priority: HIGHEST for action security_group_members [ 675.265559] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ca4bda-55ad-4a99-bcfb-fc7a64bffa01 with Priority: HIGHEST for action port [ 675.265835] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc92ef18-2831-4b38-acbe-82e66080661f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.266031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.266031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.266261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.266319] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc92ef18-2831-4b38-acbe-82e66080661f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.267691] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc92ef18-2831-4b38-acbe-82e66080661f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.267691] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.267691] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.267824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.268015] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.268092] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.268407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.268487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.268769] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.269152] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc92ef18-2831-4b38-acbe-82e66080661f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.269656] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-14ca4bda-55ad-4a99-bcfb-fc7a64bffa01 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.269774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14ca4bda-55ad-4a99-bcfb-fc7a64bffa01" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.269849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14ca4bda-55ad-4a99-bcfb-fc7a64bffa01" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.270600] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14ca4bda-55ad-4a99-bcfb-fc7a64bffa01" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.270600] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14ca4bda-55ad-4a99-bcfb-fc7a64bffa01',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.383335] env[71140]: INFO networking_nsxv3.common.synchronization [None req-320fd55d-f48e-4016-8b42-741e3a471f0a None None] Enqueued Resource ID: 2c1006d2-a2e9-48d3-9543-21cd932ccf1a with Priority: HIGHEST for action port [ 675.383335] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c1006d2-a2e9-48d3-9543-21cd932ccf1a with Priority: HIGHEST for action port [ 675.383335] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c1006d2-a2e9-48d3-9543-21cd932ccf1a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.383335] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c1006d2-a2e9-48d3-9543-21cd932ccf1a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.383335] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c1006d2-a2e9-48d3-9543-21cd932ccf1a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.384394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c1006d2-a2e9-48d3-9543-21cd932ccf1a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.385219] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c1006d2-a2e9-48d3-9543-21cd932ccf1a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.771664] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc92ef18-2831-4b38-acbe-82e66080661f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.774072] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc92ef18-2831-4b38-acbe-82e66080661f taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.774072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.778025] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14ca4bda-55ad-4a99-bcfb-fc7a64bffa01 with status ACTIVE [ 675.778025] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.778025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.778164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.778414] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.778414] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.778576] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.778631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.778710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.779332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.779332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.779724] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.779724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.779724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.779896] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.780120] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.780120] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14ca4bda-55ad-4a99-bcfb-fc7a64bffa01 is going to be updated. [ 675.808300] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.808449] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.808449] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.808613] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.808758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.808926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14ca4bda-55ad-4a99-bcfb-fc7a64bffa01" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.889430] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c1006d2-a2e9-48d3-9543-21cd932ccf1a [ 675.889430] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.889742] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.889742] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.889966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.890108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.890207] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c1006d2-a2e9-48d3-9543-21cd932ccf1a already deleted. [ 675.890293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c1006d2-a2e9-48d3-9543-21cd932ccf1a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.101368] env[71140]: INFO networking_nsxv3.common.synchronization [None req-4580dcfb-1769-4f5c-b77a-b6b69bf647c4 None None] Enqueued Resource ID: 8f5aea9f-bf84-45aa-8bfd-009161fb1003 with Priority: HIGHEST for action port [ 676.101368] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5aea9f-bf84-45aa-8bfd-009161fb1003 with Priority: HIGHEST for action port [ 676.101368] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f5aea9f-bf84-45aa-8bfd-009161fb1003 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.101368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f5aea9f-bf84-45aa-8bfd-009161fb1003" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.101368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f5aea9f-bf84-45aa-8bfd-009161fb1003" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.101368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f5aea9f-bf84-45aa-8bfd-009161fb1003" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.103839] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f5aea9f-bf84-45aa-8bfd-009161fb1003',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.273806] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc92ef18-2831-4b38-acbe-82e66080661f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.593580] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c62a92b8-4863-4e9d-809d-e8687b429f2a in Status: SUCCESS [ 676.593580] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.608329] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f5aea9f-bf84-45aa-8bfd-009161fb1003 [ 676.608329] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.608329] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.608329] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.608329] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.608329] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.608329] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f5aea9f-bf84-45aa-8bfd-009161fb1003 already deleted. [ 676.608329] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f5aea9f-bf84-45aa-8bfd-009161fb1003" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.777196] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.777405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.777461] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.777644] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.777743] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.777839] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc92ef18-2831-4b38-acbe-82e66080661f is going to be created. [ 676.799231] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca in Status: SUCCESS [ 676.799376] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.799550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.800198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.800434] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.800555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.800620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.800799] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.800882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.800965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.801067] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93e058db-48b8-4fa6-b206-7dbbf9ae47ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.803360] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.803481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.803537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.804399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.804399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.813423] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc92ef18-2831-4b38-acbe-82e66080661f in Status: UNINITIALIZED for 2s [ 677.307226] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.307226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.308445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.308445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.308445] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.308445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.308445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.308445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.308445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.308445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.308908] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.308908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.308908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.309041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.309187] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.309253] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.309346] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.309549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.309649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.309747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.309863] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93e058db-48b8-4fa6-b206-7dbbf9ae47ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.816411] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93e058db-48b8-4fa6-b206-7dbbf9ae47ca: rpc.has_security_group_logging(os_id): False [ 677.845323] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.845477] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.845561] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.845765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.845853] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.846135] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.846692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.846692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.846692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.846692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.846692] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.847307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.847307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.847307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.847307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.847576] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.847576] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.847576] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.847752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.847752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.847848] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca is going to be created. [ 677.902484] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.902672] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.902672] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.902881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.903111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.914537] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca in Status: IN_PROGRESS for 2s [ 678.233699] env[71140]: INFO networking_nsxv3.common.synchronization [None req-1f0bc98f-af34-4a4f-9cac-1402c02afd44 None None] Enqueued Resource ID: 23aeda94-ca44-4937-98eb-d15322d5b185 with Priority: HIGHEST for action port [ 678.233952] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23aeda94-ca44-4937-98eb-d15322d5b185 with Priority: HIGHEST for action port [ 678.234605] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-23aeda94-ca44-4937-98eb-d15322d5b185 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.234759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23aeda94-ca44-4937-98eb-d15322d5b185" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.234828] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23aeda94-ca44-4937-98eb-d15322d5b185" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.235053] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23aeda94-ca44-4937-98eb-d15322d5b185" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.235144] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23aeda94-ca44-4937-98eb-d15322d5b185',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.738921] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23aeda94-ca44-4937-98eb-d15322d5b185 [ 678.740933] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.741286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.741286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.741550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.741706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.741795] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23aeda94-ca44-4937-98eb-d15322d5b185 already deleted. [ 678.742056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23aeda94-ca44-4937-98eb-d15322d5b185" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.822408] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc92ef18-2831-4b38-acbe-82e66080661f in Status: SUCCESS [ 678.823840] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.823840] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.823840] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.823840] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.823840] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.823840] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.824331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.824331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.824331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.824331] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc92ef18-2831-4b38-acbe-82e66080661f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.328113] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc92ef18-2831-4b38-acbe-82e66080661f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.832839] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc92ef18-2831-4b38-acbe-82e66080661f: rpc.has_security_group_logging(os_id): False [ 679.851202] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.851202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.851202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.851202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.851202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.851202] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.851202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.851202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.851202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.851202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.851202] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc92ef18-2831-4b38-acbe-82e66080661f is going to be created. [ 679.906226] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.906226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.906226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.906226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.906226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.919136] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc92ef18-2831-4b38-acbe-82e66080661f in Status: IN_PROGRESS for 2s [ 679.923385] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca in Status: SUCCESS [ 679.923385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.064120] env[71140]: INFO networking_nsxv3.common.synchronization [req-cc242be4-3b0e-4343-84f1-4f0775cac653 req-b6fd6874-2323-4f89-9ea8-1fc6cd1ae678 tempest-ServersTestBootFromVolume-320963912 tempest-ServersTestBootFromVolume-320963912-project-member] Enqueued Resource ID: 1b5a6141-3574-468b-87ed-785459f7a84a with Priority: HIGHEST for action security_group_members [ 680.064120] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5a6141-3574-468b-87ed-785459f7a84a with Priority: HIGHEST for action security_group_members [ 680.064120] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b5a6141-3574-468b-87ed-785459f7a84a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.064120] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.064120] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.064120] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.064120] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.064120] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.067206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.067602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.067602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.067722] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b5a6141-3574-468b-87ed-785459f7a84a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.571238] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.571450] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.571567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.571879] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.572068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.572357] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.572518] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.572624] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.572855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.572947] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.573050] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b5a6141-3574-468b-87ed-785459f7a84a already deleted. [ 680.573138] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.991934] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-4 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.992283] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.992326] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.992696] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.993150] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.994042] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.994402] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.994534] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.994719] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.995055] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.995144] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.995232] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.995513] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.995513] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.995784] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.995784] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.015159] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.015159] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 681.015159] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.015485] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.015731] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-c2746d30-1f8b-44d9-b44f-ac4749f2e3b2 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.015731] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-c2746d30-1f8b-44d9-b44f-ac4749f2e3b2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.016155] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-c2746d30-1f8b-44d9-b44f-ac4749f2e3b2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.016244] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-c2746d30-1f8b-44d9-b44f-ac4749f2e3b2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.016361] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2746d30-1f8b-44d9-b44f-ac4749f2e3b2',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.520519] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.520742] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.520883] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.521672] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.521871] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.522058] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port c2746d30-1f8b-44d9-b44f-ac4749f2e3b2 not found, creating... [ 681.522452] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.522547] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.522665] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.522858] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.522999] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.523299] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.523450] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.523560] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.524632] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.524632] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.524632] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: c2746d30-1f8b-44d9-b44f-ac4749f2e3b2 is going to be created. [ 681.544173] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.544293] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.544399] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.544745] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.545036] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.545310] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-c2746d30-1f8b-44d9-b44f-ac4749f2e3b2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.929626] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc92ef18-2831-4b38-acbe-82e66080661f in Status: SUCCESS [ 681.931085] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.170897] env[71140]: INFO networking_nsxv3.common.synchronization [req-a0ad73a0-8c32-4f63-b3f1-09e91dee6221 req-ec520b64-7d9e-4643-ab7c-3365bfc92d1e tempest-ServersTestFqdnHostnames-630876233 tempest-ServersTestFqdnHostnames-630876233-project-member] Enqueued Resource ID: 55ee773a-5784-4390-9b7c-2b9d4342369e with Priority: HIGHEST for action security_group_members [ 682.171434] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55ee773a-5784-4390-9b7c-2b9d4342369e with Priority: HIGHEST for action security_group_members [ 682.172052] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-55ee773a-5784-4390-9b7c-2b9d4342369e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.172201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.172272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.172530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.172701] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.172829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.172885] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.173016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.173135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.173248] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55ee773a-5784-4390-9b7c-2b9d4342369e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.676772] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.676981] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.677078] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.677334] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.677448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.677673] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.677776] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.678593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.678593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.678593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.678593] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55ee773a-5784-4390-9b7c-2b9d4342369e already deleted. [ 682.678593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.729133] env[71140]: INFO networking_nsxv3.common.synchronization [None req-1d075e2b-6eb2-4dcd-8b60-cb130ac1f794 None None] Enqueued Resource ID: f7be44fd-9d83-4017-b4fd-deb8cd4151f5 with Priority: HIGHEST for action port [ 682.729133] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7be44fd-9d83-4017-b4fd-deb8cd4151f5 with Priority: HIGHEST for action port [ 682.729133] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7be44fd-9d83-4017-b4fd-deb8cd4151f5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.729133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7be44fd-9d83-4017-b4fd-deb8cd4151f5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.729133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7be44fd-9d83-4017-b4fd-deb8cd4151f5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.729133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7be44fd-9d83-4017-b4fd-deb8cd4151f5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.729133] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7be44fd-9d83-4017-b4fd-deb8cd4151f5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.083524] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-125 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.083717] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-125" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.083839] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-125" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.084338] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-125" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.084444] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.084663] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.084730] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.084931] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.085688] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.085954] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.086109] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.086236] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.086349] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.086550] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.086550] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.086684] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.091375] env[71140]: INFO networking_nsxv3.common.synchronization [None req-ee3ba641-9b59-4d91-ad3c-d145280640b7 None None] Enqueued Resource ID: 8990b49d-fbd5-434e-b51e-ca7c482953bc with Priority: HIGHEST for action port [ 683.094981] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8990b49d-fbd5-434e-b51e-ca7c482953bc with Priority: HIGHEST for action port [ 683.095299] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-8990b49d-fbd5-434e-b51e-ca7c482953bc taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.095422] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8990b49d-fbd5-434e-b51e-ca7c482953bc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.095482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8990b49d-fbd5-434e-b51e-ca7c482953bc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.095754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8990b49d-fbd5-434e-b51e-ca7c482953bc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.095859] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8990b49d-fbd5-434e-b51e-ca7c482953bc',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.112229] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.112229] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 683.112229] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.112229] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-125" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.112229] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-56695947-9e4c-4b05-b81b-e0612d58ec7c taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.112229] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-56695947-9e4c-4b05-b81b-e0612d58ec7c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.112229] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-56695947-9e4c-4b05-b81b-e0612d58ec7c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.112229] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-56695947-9e4c-4b05-b81b-e0612d58ec7c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.112229] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56695947-9e4c-4b05-b81b-e0612d58ec7c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.119826] env[71140]: INFO networking_nsxv3.common.synchronization [req-cc242be4-3b0e-4343-84f1-4f0775cac653 req-e0cc4b0c-f6d4-4a48-88b8-8bf0e182225a service nova] Enqueued Resource ID: 1b5a6141-3574-468b-87ed-785459f7a84a with Priority: HIGHEST for action security_group_rules [ 683.119944] env[71140]: INFO networking_nsxv3.common.synchronization [req-cc242be4-3b0e-4343-84f1-4f0775cac653 req-e0cc4b0c-f6d4-4a48-88b8-8bf0e182225a service nova] Enqueued Resource ID: 1b5a6141-3574-468b-87ed-785459f7a84a with Priority: HIGHEST for action security_group_members [ 683.120252] env[71140]: INFO networking_nsxv3.common.synchronization [req-cc242be4-3b0e-4343-84f1-4f0775cac653 req-e0cc4b0c-f6d4-4a48-88b8-8bf0e182225a service nova] Enqueued Resource ID: c2746d30-1f8b-44d9-b44f-ac4749f2e3b2 with Priority: HIGHEST for action port [ 683.120894] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5a6141-3574-468b-87ed-785459f7a84a with Priority: HIGHEST for action security_group_rules [ 683.121210] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5a6141-3574-468b-87ed-785459f7a84a with Priority: HIGHEST for action security_group_members [ 683.121323] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2746d30-1f8b-44d9-b44f-ac4749f2e3b2 with Priority: HIGHEST for action port [ 683.121696] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b5a6141-3574-468b-87ed-785459f7a84a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.121891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.122035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.123085] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.123311] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b5a6141-3574-468b-87ed-785459f7a84a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.124237] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b5a6141-3574-468b-87ed-785459f7a84a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.124351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.124426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.125026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.125026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.125026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.125026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.125224] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.125353] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.125510] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b5a6141-3574-468b-87ed-785459f7a84a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.126599] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2746d30-1f8b-44d9-b44f-ac4749f2e3b2 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.126599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2746d30-1f8b-44d9-b44f-ac4749f2e3b2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.126599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2746d30-1f8b-44d9-b44f-ac4749f2e3b2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.126790] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2746d30-1f8b-44d9-b44f-ac4749f2e3b2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.126790] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2746d30-1f8b-44d9-b44f-ac4749f2e3b2',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.234226] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7be44fd-9d83-4017-b4fd-deb8cd4151f5 [ 683.234226] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.234226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.234226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.234226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.234226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.234226] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7be44fd-9d83-4017-b4fd-deb8cd4151f5 already deleted. [ 683.234226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7be44fd-9d83-4017-b4fd-deb8cd4151f5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.598550] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8990b49d-fbd5-434e-b51e-ca7c482953bc [ 683.598760] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.598894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.598959] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.599185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.599276] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.599367] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8990b49d-fbd5-434e-b51e-ca7c482953bc already deleted. [ 683.599455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8990b49d-fbd5-434e-b51e-ca7c482953bc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.614748] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.615028] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.615175] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.615482] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.615658] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.615846] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 56695947-9e4c-4b05-b81b-e0612d58ec7c not found, creating... [ 683.616212] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.616395] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.616522] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.616894] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.617120] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.621048] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.621048] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.621048] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.621048] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.621048] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.621048] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 56695947-9e4c-4b05-b81b-e0612d58ec7c is going to be created. [ 683.629363] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b5a6141-3574-468b-87ed-785459f7a84a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.630915] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b5a6141-3574-468b-87ed-785459f7a84a taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.631059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.631842] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2746d30-1f8b-44d9-b44f-ac4749f2e3b2 with status ACTIVE [ 683.631842] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.631842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.631842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.631842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.631842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.632174] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.632174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.632174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.632389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.632448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.634517] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.634517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.634517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.634517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.634517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.634517] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2746d30-1f8b-44d9-b44f-ac4749f2e3b2 is going to be updated. [ 683.640107] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.640107] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.640107] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.640107] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.640107] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.640107] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-56695947-9e4c-4b05-b81b-e0612d58ec7c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.656515] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.656515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.656515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.656515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.656515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.656515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2746d30-1f8b-44d9-b44f-ac4749f2e3b2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.116730] env[71140]: INFO networking_nsxv3.common.synchronization [None req-78cd40c0-9ab3-41c2-8e10-a15a03c9ba3f None None] Enqueued Resource ID: 1924f474-6204-411c-b077-1582628c2fa1 with Priority: HIGHEST for action port [ 684.118783] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1924f474-6204-411c-b077-1582628c2fa1 with Priority: HIGHEST for action port [ 684.118783] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-1924f474-6204-411c-b077-1582628c2fa1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.118783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1924f474-6204-411c-b077-1582628c2fa1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.118783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1924f474-6204-411c-b077-1582628c2fa1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.118783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1924f474-6204-411c-b077-1582628c2fa1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.118783] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1924f474-6204-411c-b077-1582628c2fa1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.132349] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b5a6141-3574-468b-87ed-785459f7a84a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.622120] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1924f474-6204-411c-b077-1582628c2fa1 [ 684.622474] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.622832] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.622932] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.623169] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.623304] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.623353] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1924f474-6204-411c-b077-1582628c2fa1 already deleted. [ 684.623440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1924f474-6204-411c-b077-1582628c2fa1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.638747] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.639944] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.639944] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.639944] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.639944] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.639944] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b5a6141-3574-468b-87ed-785459f7a84a is going to be created. [ 684.663548] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.663661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.663661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.663868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.664059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.680838] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b5a6141-3574-468b-87ed-785459f7a84a in Status: UNINITIALIZED for 2s [ 684.727751] env[71140]: INFO networking_nsxv3.common.synchronization [req-a0ad73a0-8c32-4f63-b3f1-09e91dee6221 req-e6b39e91-c429-4bbf-87d0-01274f8a10ac service nova] Enqueued Resource ID: 55ee773a-5784-4390-9b7c-2b9d4342369e with Priority: HIGHEST for action security_group_rules [ 684.727908] env[71140]: INFO networking_nsxv3.common.synchronization [req-a0ad73a0-8c32-4f63-b3f1-09e91dee6221 req-e6b39e91-c429-4bbf-87d0-01274f8a10ac service nova] Enqueued Resource ID: 55ee773a-5784-4390-9b7c-2b9d4342369e with Priority: HIGHEST for action security_group_members [ 684.728072] env[71140]: INFO networking_nsxv3.common.synchronization [req-a0ad73a0-8c32-4f63-b3f1-09e91dee6221 req-e6b39e91-c429-4bbf-87d0-01274f8a10ac service nova] Enqueued Resource ID: 56695947-9e4c-4b05-b81b-e0612d58ec7c with Priority: HIGHEST for action port [ 684.728627] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55ee773a-5784-4390-9b7c-2b9d4342369e with Priority: HIGHEST for action security_group_rules [ 684.728784] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55ee773a-5784-4390-9b7c-2b9d4342369e with Priority: HIGHEST for action security_group_members [ 684.728891] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56695947-9e4c-4b05-b81b-e0612d58ec7c with Priority: HIGHEST for action port [ 684.729190] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55ee773a-5784-4390-9b7c-2b9d4342369e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.729338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.729408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.729847] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.729847] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55ee773a-5784-4390-9b7c-2b9d4342369e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.730586] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-55ee773a-5784-4390-9b7c-2b9d4342369e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.730665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.730823] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.730918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.731052] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.731272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.731272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.731381] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.731433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.731533] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55ee773a-5784-4390-9b7c-2b9d4342369e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.734995] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-56695947-9e4c-4b05-b81b-e0612d58ec7c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.735125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56695947-9e4c-4b05-b81b-e0612d58ec7c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.735190] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56695947-9e4c-4b05-b81b-e0612d58ec7c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.735356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56695947-9e4c-4b05-b81b-e0612d58ec7c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.736427] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56695947-9e4c-4b05-b81b-e0612d58ec7c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.236998] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-55ee773a-5784-4390-9b7c-2b9d4342369e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.237280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.237520] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55ee773a-5784-4390-9b7c-2b9d4342369e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.238470] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56695947-9e4c-4b05-b81b-e0612d58ec7c with status ACTIVE [ 685.238857] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.238857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.238857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.239105] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.239190] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.239380] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.239475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.239547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.239698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.239773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.240316] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.240411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.240475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.240630] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.240708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.240943] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56695947-9e4c-4b05-b81b-e0612d58ec7c is going to be updated. [ 685.263036] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.263262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.264137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.266366] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.267509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.267666] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56695947-9e4c-4b05-b81b-e0612d58ec7c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.744432] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55ee773a-5784-4390-9b7c-2b9d4342369e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.247900] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.248413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.248486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.248718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.248976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.248976] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55ee773a-5784-4390-9b7c-2b9d4342369e is going to be created. [ 686.271911] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.272033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.272033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.272249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.272413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.281723] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55ee773a-5784-4390-9b7c-2b9d4342369e in Status: UNINITIALIZED for 2s [ 686.689673] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b5a6141-3574-468b-87ed-785459f7a84a in Status: SUCCESS [ 686.690086] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.690086] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.690654] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.690654] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.690654] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.690838] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.690838] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.690905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.690995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.691345] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b5a6141-3574-468b-87ed-785459f7a84a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.729714] env[71140]: INFO networking_nsxv3.common.synchronization [None req-37879c2b-42f9-418a-9421-08992b24baa3 None None] Enqueued Resource ID: 1e52d268-7163-402d-bfef-bb882879fdad with Priority: HIGHEST for action port [ 686.730654] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e52d268-7163-402d-bfef-bb882879fdad with Priority: HIGHEST for action port [ 686.730721] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e52d268-7163-402d-bfef-bb882879fdad taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.730827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e52d268-7163-402d-bfef-bb882879fdad" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.730883] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e52d268-7163-402d-bfef-bb882879fdad" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.731155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e52d268-7163-402d-bfef-bb882879fdad" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.731259] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e52d268-7163-402d-bfef-bb882879fdad',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.142698] env[71140]: INFO networking_nsxv3.common.synchronization [None req-873db459-5e59-4c37-a3b5-010b030520b0 None None] Enqueued Resource ID: 097af3e2-64a4-42c6-a448-33e1fd050f34 with Priority: HIGHEST for action port [ 687.143246] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 097af3e2-64a4-42c6-a448-33e1fd050f34 with Priority: HIGHEST for action port [ 687.144487] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-097af3e2-64a4-42c6-a448-33e1fd050f34 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.144487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-097af3e2-64a4-42c6-a448-33e1fd050f34" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.144487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-097af3e2-64a4-42c6-a448-33e1fd050f34" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.148043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-097af3e2-64a4-42c6-a448-33e1fd050f34" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.148043] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('097af3e2-64a4-42c6-a448-33e1fd050f34',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.194091] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b5a6141-3574-468b-87ed-785459f7a84a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.236239] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e52d268-7163-402d-bfef-bb882879fdad [ 687.236525] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.236665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.236756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.236973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.237128] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.237244] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e52d268-7163-402d-bfef-bb882879fdad already deleted. [ 687.238585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e52d268-7163-402d-bfef-bb882879fdad" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.338906] env[71140]: INFO networking_nsxv3.common.synchronization [req-5b46314f-aefc-4a3a-9777-2e6c68555d37 req-b1ae5b54-15a9-4f10-8e42-ddbfc03e0c14 tempest-FloatingIPsAssociationNegativeTestJSON-1978447561 tempest-FloatingIPsAssociationNegativeTestJSON-1978447561-project-member] Enqueued Resource ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 with Priority: HIGHEST for action security_group_members [ 687.341583] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 with Priority: HIGHEST for action security_group_members [ 687.341583] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f065f4e4-d6ea-4bca-9d45-213c57a908b4 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.341583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.341583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.341583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.341583] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.341583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.341583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.341583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.341583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.341583] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f065f4e4-d6ea-4bca-9d45-213c57a908b4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.650976] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 097af3e2-64a4-42c6-a448-33e1fd050f34 [ 687.651367] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.651431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.651503] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.651746] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.651843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.651974] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:097af3e2-64a4-42c6-a448-33e1fd050f34 already deleted. [ 687.652134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-097af3e2-64a4-42c6-a448-33e1fd050f34" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.694107] env[71140]: INFO networking_nsxv3.common.synchronization [None req-490ca14c-551b-41d4-919c-238714d63cee None None] Enqueued Resource ID: 01e47152-a3fb-4bcc-86bb-3c29fea436c5 with Priority: HIGHEST for action port [ 687.697810] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01e47152-a3fb-4bcc-86bb-3c29fea436c5 with Priority: HIGHEST for action port [ 687.697810] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-01e47152-a3fb-4bcc-86bb-3c29fea436c5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.697810] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01e47152-a3fb-4bcc-86bb-3c29fea436c5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.697810] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01e47152-a3fb-4bcc-86bb-3c29fea436c5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.697810] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01e47152-a3fb-4bcc-86bb-3c29fea436c5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.697810] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01e47152-a3fb-4bcc-86bb-3c29fea436c5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.700808] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b5a6141-3574-468b-87ed-785459f7a84a: rpc.has_security_group_logging(os_id): False [ 687.719201] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.719201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.719201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.719201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.719201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.719201] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.719201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.719201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.719201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.719201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.719201] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b5a6141-3574-468b-87ed-785459f7a84a is going to be created. [ 687.777470] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.779269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.779350] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.779617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.779770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.790950] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b5a6141-3574-468b-87ed-785459f7a84a in Status: IN_PROGRESS for 2s [ 687.850502] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.850502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.850502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.850502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.850502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.850502] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.850502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.850502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.850502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.850502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.850502] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 is going to be updated. [ 687.900011] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.900011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.900011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.900011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.900011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.906797] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 in Status: IN_PROGRESS for 2s [ 687.970873] env[71140]: INFO networking_nsxv3.common.synchronization [None req-e724c2f4-16d7-4932-835c-d347d2cb1c97 tempest-AttachVolumeShelveTestJSON-926657130 tempest-AttachVolumeShelveTestJSON-926657130-project-member] Enqueued Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGHEST for action security_group_rules [ 687.971778] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGHEST for action security_group_rules [ 687.971778] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.971778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.971778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.972041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.972914] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.203034] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01e47152-a3fb-4bcc-86bb-3c29fea436c5 [ 688.203034] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.203034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.203034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.203034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.203034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.203830] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01e47152-a3fb-4bcc-86bb-3c29fea436c5 already deleted. [ 688.206412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01e47152-a3fb-4bcc-86bb-3c29fea436c5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.266195] env[71140]: INFO networking_nsxv3.common.synchronization [None req-988b7669-0064-4a4e-acdf-685e31f7583c tempest-AttachVolumeShelveTestJSON-926657130 tempest-AttachVolumeShelveTestJSON-926657130-project-member] Enqueued Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGHEST for action security_group_rules [ 688.268345] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGHEST for action security_group_rules [ 688.268576] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.268857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.291353] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55ee773a-5784-4390-9b7c-2b9d4342369e in Status: SUCCESS [ 688.291589] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.291754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.291983] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.292196] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.292312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.292376] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.292533] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.295018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.295018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.295018] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55ee773a-5784-4390-9b7c-2b9d4342369e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.498295] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.498295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.498295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.498295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.498295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.498295] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 already deleted. [ 688.498295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.498295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.498295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.498295] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.796280] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55ee773a-5784-4390-9b7c-2b9d4342369e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.022046] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.022455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.022455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.022455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.022687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.022899] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 already deleted. [ 689.022899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.280643] env[71140]: INFO networking_nsxv3.common.synchronization [None req-4569e9cc-5953-405f-8b65-32022edb16fb None None] Enqueued Resource ID: 4f46d10a-6750-4de6-af96-f2f753fc262a with Priority: HIGHEST for action port [ 689.281372] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f46d10a-6750-4de6-af96-f2f753fc262a with Priority: HIGHEST for action port [ 689.281473] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f46d10a-6750-4de6-af96-f2f753fc262a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.281595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f46d10a-6750-4de6-af96-f2f753fc262a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.281665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f46d10a-6750-4de6-af96-f2f753fc262a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.281914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f46d10a-6750-4de6-af96-f2f753fc262a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.281992] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f46d10a-6750-4de6-af96-f2f753fc262a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.298165] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55ee773a-5784-4390-9b7c-2b9d4342369e: rpc.has_security_group_logging(os_id): False [ 689.376123] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.376449] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.376449] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.376610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.376729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.376949] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.377169] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.377169] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.377341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.377388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.377503] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55ee773a-5784-4390-9b7c-2b9d4342369e is going to be created. [ 689.429992] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.434573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.434573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.434573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.434747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.444481] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55ee773a-5784-4390-9b7c-2b9d4342369e in Status: IN_PROGRESS for 2s [ 689.789412] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f46d10a-6750-4de6-af96-f2f753fc262a [ 689.789412] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.789412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.789412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.789412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.789412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.789412] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f46d10a-6750-4de6-af96-f2f753fc262a already deleted. [ 689.789412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f46d10a-6750-4de6-af96-f2f753fc262a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.803789] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b5a6141-3574-468b-87ed-785459f7a84a in Status: SUCCESS [ 689.803789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.917842] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 in Status: SUCCESS [ 689.918039] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 deletion is rescheduled due to dependency. [ 689.918158] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.675977] env[71140]: INFO networking_nsxv3.common.synchronization [req-e431f9a5-a570-46d5-aadc-f23a217984da req-7f7e8d31-f16f-4eed-b8d0-40f498e8efcd tempest-ServerAddressesNegativeTestJSON-721148734 tempest-ServerAddressesNegativeTestJSON-721148734-project-member] Enqueued Resource ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 with Priority: HIGHEST for action security_group_members [ 690.676820] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 with Priority: HIGHEST for action security_group_members [ 690.677664] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-083af43f-5ab0-4b05-a7bb-d6121e5f0390 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.677903] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.677977] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.678401] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.678519] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.678582] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.678617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.678854] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.678854] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.678936] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('083af43f-5ab0-4b05-a7bb-d6121e5f0390',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.751963] env[71140]: INFO networking_nsxv3.common.synchronization [None req-c777225e-a2ea-4fc8-9ec8-543bf65d40f6 None None] Enqueued Resource ID: 01277c6b-b858-40de-b3f7-1bf4565c4c61 with Priority: HIGHEST for action port [ 690.752268] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01277c6b-b858-40de-b3f7-1bf4565c4c61 with Priority: HIGHEST for action port [ 690.753197] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-01277c6b-b858-40de-b3f7-1bf4565c4c61 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.753318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01277c6b-b858-40de-b3f7-1bf4565c4c61" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.753388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01277c6b-b858-40de-b3f7-1bf4565c4c61" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.753730] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01277c6b-b858-40de-b3f7-1bf4565c4c61" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.753788] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01277c6b-b858-40de-b3f7-1bf4565c4c61',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.184101] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.184101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.184101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.184101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.184101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.184101] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.184101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.184101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.184101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.184101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.184101] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 already deleted. [ 691.184101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.256486] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01277c6b-b858-40de-b3f7-1bf4565c4c61 [ 691.256882] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.260186] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.260186] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.260186] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.260186] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.260186] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01277c6b-b858-40de-b3f7-1bf4565c4c61 already deleted. [ 691.260186] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01277c6b-b858-40de-b3f7-1bf4565c4c61" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.335114] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-65 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.335352] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-65" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.335476] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-65" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.337013] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-65" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.337420] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.337600] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.337762] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.337969] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.339309] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.339309] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 691.339309] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.339309] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.340489] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.340639] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 691.340754] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.340918] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.360478] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.360478] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 691.360709] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.360824] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-65" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.361217] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-81121af1-25dc-4713-b443-184f8bae8e4b taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.362700] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-81121af1-25dc-4713-b443-184f8bae8e4b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.362700] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-81121af1-25dc-4713-b443-184f8bae8e4b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.363112] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-81121af1-25dc-4713-b443-184f8bae8e4b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.363112] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81121af1-25dc-4713-b443-184f8bae8e4b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.460637] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55ee773a-5784-4390-9b7c-2b9d4342369e in Status: SUCCESS [ 691.460637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.869043] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.869043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.869043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.869043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.869043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.869043] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 81121af1-25dc-4713-b443-184f8bae8e4b not found, creating... [ 691.869043] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.869043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.869043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.869043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.869897] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.869897] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.869897] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.872324] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.872659] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.872892] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.876720] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 81121af1-25dc-4713-b443-184f8bae8e4b is going to be created. [ 691.896730] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.896730] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.896730] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.896730] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.896996] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.897043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-81121af1-25dc-4713-b443-184f8bae8e4b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.523206] env[71140]: INFO networking_nsxv3.common.synchronization [None req-97002a59-e503-40d2-b279-d622231c8f10 None None] Enqueued Resource ID: e4357853-5d41-4a7d-81bd-c3a3c6d23a80 with Priority: HIGHEST for action port [ 692.523419] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4357853-5d41-4a7d-81bd-c3a3c6d23a80 with Priority: HIGHEST for action port [ 692.523816] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4357853-5d41-4a7d-81bd-c3a3c6d23a80 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.523939] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4357853-5d41-4a7d-81bd-c3a3c6d23a80" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.524824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4357853-5d41-4a7d-81bd-c3a3c6d23a80" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.527560] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4357853-5d41-4a7d-81bd-c3a3c6d23a80" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.527560] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4357853-5d41-4a7d-81bd-c3a3c6d23a80',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.756243] env[71140]: INFO networking_nsxv3.common.synchronization [req-83d901c0-8af0-43d5-965f-58d3e5e7f6aa req-31434527-64f1-40d7-a16e-5d7a3d587a60 tempest-TenantUsagesTestJSON-604056561 tempest-TenantUsagesTestJSON-604056561-project-member] Enqueued Resource ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca with Priority: HIGHEST for action security_group_members [ 692.756747] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca with Priority: HIGHEST for action security_group_members [ 692.757054] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.757242] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.757281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.758212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.758212] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.758212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.758212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.758212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.760201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.760284] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93e058db-48b8-4fa6-b206-7dbbf9ae47ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.030742] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4357853-5d41-4a7d-81bd-c3a3c6d23a80 [ 693.030742] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.030742] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.030742] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.030742] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.030742] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.030742] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4357853-5d41-4a7d-81bd-c3a3c6d23a80 already deleted. [ 693.030742] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4357853-5d41-4a7d-81bd-c3a3c6d23a80" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.139380] env[71140]: INFO networking_nsxv3.common.synchronization [req-e431f9a5-a570-46d5-aadc-f23a217984da req-dc753909-512f-4e62-9604-6bc8835aeb59 service nova] Enqueued Resource ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 with Priority: HIGHEST for action security_group_rules [ 693.139380] env[71140]: INFO networking_nsxv3.common.synchronization [req-e431f9a5-a570-46d5-aadc-f23a217984da req-dc753909-512f-4e62-9604-6bc8835aeb59 service nova] Enqueued Resource ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 with Priority: HIGHEST for action security_group_members [ 693.139380] env[71140]: INFO networking_nsxv3.common.synchronization [req-e431f9a5-a570-46d5-aadc-f23a217984da req-dc753909-512f-4e62-9604-6bc8835aeb59 service nova] Enqueued Resource ID: 81121af1-25dc-4713-b443-184f8bae8e4b with Priority: HIGHEST for action port [ 693.139380] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 with Priority: HIGHEST for action security_group_rules [ 693.139380] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 with Priority: HIGHEST for action security_group_members [ 693.139380] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81121af1-25dc-4713-b443-184f8bae8e4b with Priority: HIGHEST for action port [ 693.140379] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-083af43f-5ab0-4b05-a7bb-d6121e5f0390 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.142286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.142363] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.145757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.145757] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('083af43f-5ab0-4b05-a7bb-d6121e5f0390',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.146673] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-083af43f-5ab0-4b05-a7bb-d6121e5f0390 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.146734] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.146771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.150024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.150024] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.150024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.150024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.150024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.150024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.150024] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('083af43f-5ab0-4b05-a7bb-d6121e5f0390',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.150024] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-81121af1-25dc-4713-b443-184f8bae8e4b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.150024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81121af1-25dc-4713-b443-184f8bae8e4b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.150024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81121af1-25dc-4713-b443-184f8bae8e4b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.150024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81121af1-25dc-4713-b443-184f8bae8e4b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.150024] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81121af1-25dc-4713-b443-184f8bae8e4b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.263759] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.263759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.263759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.263988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.264056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.264225] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.264320] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.264697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.264697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.264697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.264697] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca is going to be updated. [ 693.291025] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.291160] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.291160] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.291434] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.291651] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.300450] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca in Status: IN_PROGRESS for 2s [ 693.349095] env[71140]: INFO networking_nsxv3.common.synchronization [None req-acb9f881-d6b8-40a8-a6c0-bb4aee1368ac tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 with Priority: HIGHEST for action security_group_rules [ 693.349668] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 with Priority: HIGHEST for action security_group_rules [ 693.350035] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcc20535-4cb4-4221-b041-8dd02e4b3787 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.350035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.350035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.350432] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.350432] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcc20535-4cb4-4221-b041-8dd02e4b3787',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.599640] env[71140]: INFO networking_nsxv3.common.synchronization [None req-fbd96438-433c-4a54-ae6b-1e0ac117fd70 tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 with Priority: HIGHEST for action security_group_rules [ 693.601532] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 with Priority: HIGHEST for action security_group_rules [ 693.601532] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcc20535-4cb4-4221-b041-8dd02e4b3787 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.601532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.651606] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-083af43f-5ab0-4b05-a7bb-d6121e5f0390 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.651835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.655024] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('083af43f-5ab0-4b05-a7bb-d6121e5f0390',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.655024] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81121af1-25dc-4713-b443-184f8bae8e4b with status ACTIVE [ 693.655024] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.655024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.655024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.655024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.655024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.655024] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.655024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.655024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.655024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.655024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.655024] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.655024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.655024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.655878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.655878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.655878] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81121af1-25dc-4713-b443-184f8bae8e4b is going to be updated. [ 693.675038] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.675271] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.675384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.675631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.676442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.676737] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81121af1-25dc-4713-b443-184f8bae8e4b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.877020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.877020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.877020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.877020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.877020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.877020] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 already deleted. [ 693.877020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.877020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.877020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.877020] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcc20535-4cb4-4221-b041-8dd02e4b3787',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.105959] env[71140]: INFO networking_nsxv3.common.synchronization [None req-1ea46106-211f-4c6d-b706-644e7192f823 None None] Enqueued Resource ID: 70a08000-fc9d-486f-91af-663e7c63f80b with Priority: HIGHEST for action port [ 694.106650] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70a08000-fc9d-486f-91af-663e7c63f80b with Priority: HIGHEST for action port [ 694.106961] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-70a08000-fc9d-486f-91af-663e7c63f80b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.107105] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70a08000-fc9d-486f-91af-663e7c63f80b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.107186] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70a08000-fc9d-486f-91af-663e7c63f80b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.107432] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70a08000-fc9d-486f-91af-663e7c63f80b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.107521] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70a08000-fc9d-486f-91af-663e7c63f80b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.160949] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('083af43f-5ab0-4b05-a7bb-d6121e5f0390',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.396878] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.397103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.397200] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.397363] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.397454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.397548] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 already deleted. [ 694.397635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.611017] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70a08000-fc9d-486f-91af-663e7c63f80b [ 694.611707] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.611707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.611707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.611707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.612497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.612497] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70a08000-fc9d-486f-91af-663e7c63f80b already deleted. [ 694.612497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70a08000-fc9d-486f-91af-663e7c63f80b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.663109] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.663276] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.663343] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.666937] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.667059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.667182] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 is going to be created. [ 694.692019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.692019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.692019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.692019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.692019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.700165] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 in Status: UNINITIALIZED for 2s [ 695.167908] env[71140]: INFO networking_nsxv3.common.synchronization [req-8e5cb7bc-7cc6-48e6-9a5d-31e7ae206a0b req-ed920c01-b8f3-430f-bd46-0763edee663b tempest-ServerActionsTestOtherB-2025667431 tempest-ServerActionsTestOtherB-2025667431-project-member] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 695.171827] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 695.171827] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.171827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.171827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.171827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.171827] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.171827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.171827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.171827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.171827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.171827] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.312806] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca in Status: SUCCESS [ 695.312859] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca deletion is rescheduled due to dependency. [ 695.313212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.676613] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.676808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.676913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.677314] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.677314] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.677491] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.677810] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.677810] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.677810] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.678200] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.678200] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c already deleted. [ 695.678200] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.932083] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.932083] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.932083] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.933218] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.935565] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.935565] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.935565] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.935565] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.935565] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.935565] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.935565] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.936472] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.936472] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.936472] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.936655] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.936768] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.977585] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.977770] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 695.977989] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.978174] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.978460] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-3280961f-7e46-42c9-8b97-ec7eee7326bf taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.979229] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-3280961f-7e46-42c9-8b97-ec7eee7326bf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.979948] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-3280961f-7e46-42c9-8b97-ec7eee7326bf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.979948] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-3280961f-7e46-42c9-8b97-ec7eee7326bf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.979948] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3280961f-7e46-42c9-8b97-ec7eee7326bf',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.251285] env[71140]: INFO networking_nsxv3.common.synchronization [None req-9eacacce-106b-4939-9871-7631917c0f7c None None] Enqueued Resource ID: 382ea257-010e-45a3-a7a7-7a8a623e70e2 with Priority: HIGHEST for action port [ 696.251285] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 382ea257-010e-45a3-a7a7-7a8a623e70e2 with Priority: HIGHEST for action port [ 696.251285] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-382ea257-010e-45a3-a7a7-7a8a623e70e2 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.251285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-382ea257-010e-45a3-a7a7-7a8a623e70e2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.251285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-382ea257-010e-45a3-a7a7-7a8a623e70e2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.251285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-382ea257-010e-45a3-a7a7-7a8a623e70e2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.251285] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('382ea257-010e-45a3-a7a7-7a8a623e70e2',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.402360] env[71140]: INFO networking_nsxv3.common.synchronization [None req-e324f07f-9fd5-47cf-846c-28161a0b9143 None None] Enqueued Resource ID: 1edd27b5-415c-4c9a-932d-2bbe6157d23e with Priority: HIGHEST for action port [ 696.402360] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1edd27b5-415c-4c9a-932d-2bbe6157d23e with Priority: HIGHEST for action port [ 696.402360] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-1edd27b5-415c-4c9a-932d-2bbe6157d23e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.402360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1edd27b5-415c-4c9a-932d-2bbe6157d23e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.402360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1edd27b5-415c-4c9a-932d-2bbe6157d23e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.403085] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1edd27b5-415c-4c9a-932d-2bbe6157d23e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.403376] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1edd27b5-415c-4c9a-932d-2bbe6157d23e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.488043] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.488043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.488043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.488043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.488043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.488043] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 3280961f-7e46-42c9-8b97-ec7eee7326bf not found, creating... [ 696.488043] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.488043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.488043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.488043] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.488524] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.488524] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.488524] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.494297] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.494297] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.494297] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.494297] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 3280961f-7e46-42c9-8b97-ec7eee7326bf is going to be created. [ 696.516699] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.517135] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.517840] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.518346] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.519547] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.519643] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-3280961f-7e46-42c9-8b97-ec7eee7326bf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.715668] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 in Status: SUCCESS [ 696.716046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.716199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.716420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.716623] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.716756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.716839] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.717139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.717139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.717379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.717379] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('083af43f-5ab0-4b05-a7bb-d6121e5f0390',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.755815] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 382ea257-010e-45a3-a7a7-7a8a623e70e2 [ 696.755815] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.755815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.755815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.755815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.755815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.755815] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:382ea257-010e-45a3-a7a7-7a8a623e70e2 already deleted. [ 696.755815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-382ea257-010e-45a3-a7a7-7a8a623e70e2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.909974] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1edd27b5-415c-4c9a-932d-2bbe6157d23e [ 696.910987] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.910987] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.910987] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.910987] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.910987] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.910987] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1edd27b5-415c-4c9a-932d-2bbe6157d23e already deleted. [ 696.910987] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1edd27b5-415c-4c9a-932d-2bbe6157d23e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.221966] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-083af43f-5ab0-4b05-a7bb-d6121e5f0390 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.221966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.222135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.222281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.222547] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.222547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.222705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.222743] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.222827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.222893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.223050] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-083af43f-5ab0-4b05-a7bb-d6121e5f0390 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.223145] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.223200] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.223344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.223480] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.223569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.223626] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.223763] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.223836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.223906] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.223985] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('083af43f-5ab0-4b05-a7bb-d6121e5f0390',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.302663] env[71140]: INFO networking_nsxv3.common.synchronization [req-0a54a3bf-5d8e-43c0-8c50-73ba7ed21318 req-9c36d5a8-105b-41e3-9d6c-2af58737b951 tempest-ServersAdminTestJSON-2080308680 tempest-ServersAdminTestJSON-2080308680-project-member] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 697.305872] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 697.306721] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.307085] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.308531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.308531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.308531] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.308531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.308531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.308531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.308531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.308531] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.727434] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 083af43f-5ab0-4b05-a7bb-d6121e5f0390: rpc.has_security_group_logging(os_id): False [ 697.746340] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.746892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.746892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.746892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.746892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.747158] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.747247] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.747247] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.747481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.747481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.747735] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.747735] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.747836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.748076] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.748076] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.748193] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.748828] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.748828] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.748828] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.748828] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.748828] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 is going to be created. [ 697.806339] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.806446] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.806526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.806737] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.806922] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.813015] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.819960] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 in Status: IN_PROGRESS for 2s [ 697.832032] env[71140]: INFO networking_nsxv3.common.synchronization [req-8e5cb7bc-7cc6-48e6-9a5d-31e7ae206a0b req-512aa660-7b29-4bf7-b092-22d0a8007242 service nova] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_rules [ 697.832032] env[71140]: INFO networking_nsxv3.common.synchronization [req-8e5cb7bc-7cc6-48e6-9a5d-31e7ae206a0b req-512aa660-7b29-4bf7-b092-22d0a8007242 service nova] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 697.832032] env[71140]: INFO networking_nsxv3.common.synchronization [req-8e5cb7bc-7cc6-48e6-9a5d-31e7ae206a0b req-512aa660-7b29-4bf7-b092-22d0a8007242 service nova] Enqueued Resource ID: 3280961f-7e46-42c9-8b97-ec7eee7326bf with Priority: HIGHEST for action port [ 697.832295] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_rules [ 697.832430] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 697.832527] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3280961f-7e46-42c9-8b97-ec7eee7326bf with Priority: HIGHEST for action port [ 697.834462] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.834462] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.834462] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.834659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.834760] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.835760] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.835760] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.835760] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.835939] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.835978] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.836070] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.836165] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.836364] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.836364] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.836492] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.838338] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-3280961f-7e46-42c9-8b97-ec7eee7326bf taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.839072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3280961f-7e46-42c9-8b97-ec7eee7326bf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.839072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3280961f-7e46-42c9-8b97-ec7eee7326bf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.839072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3280961f-7e46-42c9-8b97-ec7eee7326bf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.839072] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3280961f-7e46-42c9-8b97-ec7eee7326bf',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.317072] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.339253] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.340868] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.341008] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.341162] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3280961f-7e46-42c9-8b97-ec7eee7326bf with status ACTIVE [ 698.341322] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.341428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.341490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.341697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.341804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.341978] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.342598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.342698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.342843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.342930] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.343133] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.343230] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.343363] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.343525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.343605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.343692] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3280961f-7e46-42c9-8b97-ec7eee7326bf is going to be updated. [ 698.364511] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.364756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.364756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.365060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.365475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.365475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3280961f-7e46-42c9-8b97-ec7eee7326bf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.416574] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-181 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.416806] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-181" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.416806] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-181" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.417134] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-181" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.417389] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.417538] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.417792] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.417950] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.419457] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.419457] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.419457] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.419457] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.419457] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.419457] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.419457] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.419927] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.453514] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.453514] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 698.453676] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.453843] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-181" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.454266] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-3d9c90fc-94fe-4f72-9454-0e21a19e57d3 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.454591] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-3d9c90fc-94fe-4f72-9454-0e21a19e57d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.454735] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-3d9c90fc-94fe-4f72-9454-0e21a19e57d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.455081] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-3d9c90fc-94fe-4f72-9454-0e21a19e57d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.455226] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d9c90fc-94fe-4f72-9454-0e21a19e57d3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.822863] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.822863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.822863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.822863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.822863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.822863] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be updated. [ 698.847036] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.850567] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.850567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.850687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.850845] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.851023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.861109] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: IN_PROGRESS for 2s [ 698.935142] env[71140]: INFO networking_nsxv3.common.synchronization [None req-3a34c1d4-6b8f-4a93-a63a-9df4c8d44993 None None] Enqueued Resource ID: 30fe6d65-bca6-488f-977b-c3df77d83dc1 with Priority: HIGHEST for action port [ 698.935683] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30fe6d65-bca6-488f-977b-c3df77d83dc1 with Priority: HIGHEST for action port [ 698.936077] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-30fe6d65-bca6-488f-977b-c3df77d83dc1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.936338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30fe6d65-bca6-488f-977b-c3df77d83dc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.936411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30fe6d65-bca6-488f-977b-c3df77d83dc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.936772] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30fe6d65-bca6-488f-977b-c3df77d83dc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.936848] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30fe6d65-bca6-488f-977b-c3df77d83dc1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.959566] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.959793] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.959942] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.960257] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.960447] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.960616] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 3d9c90fc-94fe-4f72-9454-0e21a19e57d3 not found, creating... [ 698.960885] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.961052] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.961171] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.961398] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.961537] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.961814] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.961978] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.963191] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.965267] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.965419] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.965567] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 3d9c90fc-94fe-4f72-9454-0e21a19e57d3 is going to be created. [ 698.988741] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.990198] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.990406] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.994569] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.994651] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.994836] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-3d9c90fc-94fe-4f72-9454-0e21a19e57d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.029778] env[71140]: INFO networking_nsxv3.common.synchronization [None req-96d167fb-6593-44a1-97bb-d1f9709068a8 None None] Enqueued Resource ID: 66fc2a19-28a3-470f-8d5b-74dd0f88a746 with Priority: HIGHEST for action port [ 699.029778] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66fc2a19-28a3-470f-8d5b-74dd0f88a746 with Priority: HIGHEST for action port [ 699.029778] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-66fc2a19-28a3-470f-8d5b-74dd0f88a746 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.029778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66fc2a19-28a3-470f-8d5b-74dd0f88a746" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.029778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66fc2a19-28a3-470f-8d5b-74dd0f88a746" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.029778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66fc2a19-28a3-470f-8d5b-74dd0f88a746" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.029778] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66fc2a19-28a3-470f-8d5b-74dd0f88a746',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.356206] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.356206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.356206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.356206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.356206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.356206] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c is going to be created. [ 699.410695] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.410904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.410956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.411221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.412012] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.422636] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: UNINITIALIZED for 2s [ 699.439853] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30fe6d65-bca6-488f-977b-c3df77d83dc1 [ 699.440137] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.440282] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.440373] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.440604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.440696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.440885] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30fe6d65-bca6-488f-977b-c3df77d83dc1 already deleted. [ 699.440885] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30fe6d65-bca6-488f-977b-c3df77d83dc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.532790] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66fc2a19-28a3-470f-8d5b-74dd0f88a746 [ 699.533235] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.533389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.533501] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.534388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.534388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.534388] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66fc2a19-28a3-470f-8d5b-74dd0f88a746 already deleted. [ 699.534388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66fc2a19-28a3-470f-8d5b-74dd0f88a746" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.834840] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 in Status: SUCCESS [ 699.834840] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.112613] env[71140]: INFO networking_nsxv3.common.synchronization [req-0a54a3bf-5d8e-43c0-8c50-73ba7ed21318 req-f6c23ad7-e49b-472c-98c8-80ca763e013a service nova] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_rules [ 700.112729] env[71140]: INFO networking_nsxv3.common.synchronization [req-0a54a3bf-5d8e-43c0-8c50-73ba7ed21318 req-f6c23ad7-e49b-472c-98c8-80ca763e013a service nova] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 700.112899] env[71140]: INFO networking_nsxv3.common.synchronization [req-0a54a3bf-5d8e-43c0-8c50-73ba7ed21318 req-f6c23ad7-e49b-472c-98c8-80ca763e013a service nova] Enqueued Resource ID: 3d9c90fc-94fe-4f72-9454-0e21a19e57d3 with Priority: HIGHEST for action port [ 700.113365] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_rules [ 700.113365] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 700.113365] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d9c90fc-94fe-4f72-9454-0e21a19e57d3 with Priority: HIGHEST for action port [ 700.113981] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.113981] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.115143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.115372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.115487] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.116362] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.116459] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.116653] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d9c90fc-94fe-4f72-9454-0e21a19e57d3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.116755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d9c90fc-94fe-4f72-9454-0e21a19e57d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.116820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d9c90fc-94fe-4f72-9454-0e21a19e57d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.116995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d9c90fc-94fe-4f72-9454-0e21a19e57d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.117088] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d9c90fc-94fe-4f72-9454-0e21a19e57d3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.232891] env[71140]: INFO networking_nsxv3.common.synchronization [None req-77c0760b-2cfb-422e-ab0f-066662317593 None None] Enqueued Resource ID: 30fd56f3-383f-4014-b788-d0254501fd00 with Priority: HIGHEST for action port [ 700.232891] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30fd56f3-383f-4014-b788-d0254501fd00 with Priority: HIGHEST for action port [ 700.232891] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-30fd56f3-383f-4014-b788-d0254501fd00 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.232891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30fd56f3-383f-4014-b788-d0254501fd00" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.232891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30fd56f3-383f-4014-b788-d0254501fd00" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.232891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30fd56f3-383f-4014-b788-d0254501fd00" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.233406] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30fd56f3-383f-4014-b788-d0254501fd00',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.464702] env[71140]: INFO networking_nsxv3.common.synchronization [None req-1539eb4d-6c5f-4fd0-b816-2cdda89bad49 None None] Enqueued Resource ID: 0c63cbd6-60e1-45a9-90ae-0777b6b837f9 with Priority: HIGHEST for action port [ 700.465773] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c63cbd6-60e1-45a9-90ae-0777b6b837f9 with Priority: HIGHEST for action port [ 700.465773] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c63cbd6-60e1-45a9-90ae-0777b6b837f9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.465773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c63cbd6-60e1-45a9-90ae-0777b6b837f9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.465960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c63cbd6-60e1-45a9-90ae-0777b6b837f9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.466094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c63cbd6-60e1-45a9-90ae-0777b6b837f9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.466227] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c63cbd6-60e1-45a9-90ae-0777b6b837f9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.618860] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.619064] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.619338] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d9c90fc-94fe-4f72-9454-0e21a19e57d3 with status ACTIVE [ 700.619443] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.619553] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.619553] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.619732] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.619827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.620017] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.620245] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.620245] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.620373] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.620455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.621119] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.621119] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.621119] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.621119] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.621119] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.621119] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d9c90fc-94fe-4f72-9454-0e21a19e57d3 is going to be updated. [ 700.641332] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.641332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.641332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.641332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.641612] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.641612] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d9c90fc-94fe-4f72-9454-0e21a19e57d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.736556] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30fd56f3-383f-4014-b788-d0254501fd00 [ 700.736787] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.736920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.736986] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.737255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.737349] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.737449] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30fd56f3-383f-4014-b788-d0254501fd00 already deleted. [ 700.737527] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30fd56f3-383f-4014-b788-d0254501fd00" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.877824] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: SUCCESS [ 700.878063] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.878243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.878463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.878650] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.878760] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.878840] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.878974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.879077] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.879171] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.950460] env[71140]: INFO networking_nsxv3.common.synchronization [req-1700518e-82af-4500-a89a-114bc9d07700 req-b1db79b6-db81-4271-b100-9a1a6f1c62a5 tempest-ServerMetadataTestJSON-1889177665 tempest-ServerMetadataTestJSON-1889177665-project-member] Enqueued Resource ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 with Priority: HIGHEST for action security_group_members [ 700.951186] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 with Priority: HIGHEST for action security_group_members [ 700.951470] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-622a5b07-14ae-44ec-94dd-57b4349034a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.951619] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.951709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.951976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.952202] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.952362] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.952497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.952698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.952852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.953048] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('622a5b07-14ae-44ec-94dd-57b4349034a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.969928] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c63cbd6-60e1-45a9-90ae-0777b6b837f9 [ 700.969928] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.969928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.969928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.969928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.969928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.969928] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c63cbd6-60e1-45a9-90ae-0777b6b837f9 already deleted. [ 700.971134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c63cbd6-60e1-45a9-90ae-0777b6b837f9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.382127] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.431867] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: SUCCESS [ 701.434054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.434054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.434054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.434054] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.434054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.434054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.434054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.434054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.434054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.434054] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.455871] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.456038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.456110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.456422] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.456532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.456744] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.456855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.456994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.457185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.457185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.457293] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 is going to be updated. [ 701.485215] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.485575] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.485575] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.485745] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.485845] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.494599] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 in Status: IN_PROGRESS for 2s [ 701.885133] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.937896] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.340686] env[71140]: INFO networking_nsxv3.common.synchronization [req-a800a38a-d2ab-4478-981b-250835307b56 req-942f2410-34fe-49a2-9f4f-29c26124f224 tempest-ServersTestManualDisk-1307284355 tempest-ServersTestManualDisk-1307284355-project-member] Enqueued Resource ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 with Priority: HIGHEST for action security_group_members [ 702.341292] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 with Priority: HIGHEST for action security_group_members [ 702.341641] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-604d5290-2f79-4d99-b6f1-1e0335d615a9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.341764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.341827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.344801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.344801] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.344801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.347056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.347056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.347056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.347056] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('604d5290-2f79-4d99-b6f1-1e0335d615a9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.392023] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.392023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.392023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.392023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.392023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.392023] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be updated. [ 702.421033] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.421033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.422334] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.422334] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.422334] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.431973] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: IN_PROGRESS for 2s [ 702.440722] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c99ec8b-0259-4916-a240-54938fc5a81c: rpc.has_security_group_logging(os_id): False [ 702.458309] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.458585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.458585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.458764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.458843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.459118] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.459343] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.459343] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.459476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.459554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.459644] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c is going to be created. [ 702.517364] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.517721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.517721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.517864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.518067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.531191] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: IN_PROGRESS for 2s [ 702.853599] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.853599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.853599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.853599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.853599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.853599] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.853599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.853599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.853599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.853599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.853599] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 already deleted. [ 702.853599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.102273] env[71140]: INFO networking_nsxv3.common.synchronization [None req-21a3bb9f-b051-45cb-b4a5-c20ceb54df9a None None] Enqueued Resource ID: 5d6d04fe-5c8f-429c-a53c-3624e93ccf17 with Priority: HIGHEST for action port [ 703.102529] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d6d04fe-5c8f-429c-a53c-3624e93ccf17 with Priority: HIGHEST for action port [ 703.103112] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d6d04fe-5c8f-429c-a53c-3624e93ccf17 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.103241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d6d04fe-5c8f-429c-a53c-3624e93ccf17" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.104468] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d6d04fe-5c8f-429c-a53c-3624e93ccf17" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.104468] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d6d04fe-5c8f-429c-a53c-3624e93ccf17" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.104468] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d6d04fe-5c8f-429c-a53c-3624e93ccf17',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.172467] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-14 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.172467] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-14" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.172467] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-14" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.172467] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-14" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.177022] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.177022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.177022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.177022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.177022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.177022] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.177022] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.177022] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.177022] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.177022] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.177022] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.177022] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.208030] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.208030] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 703.208030] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.208030] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-14" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.208296] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-f47b3078-02c4-4038-890a-f5b09f136e31 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.208655] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-f47b3078-02c4-4038-890a-f5b09f136e31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.208886] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-f47b3078-02c4-4038-890a-f5b09f136e31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.209321] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-f47b3078-02c4-4038-890a-f5b09f136e31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.209570] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f47b3078-02c4-4038-890a-f5b09f136e31',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.387788] env[71140]: INFO networking_nsxv3.common.synchronization [None req-ce5ff3a9-cd48-415f-8013-cd2c6025ce0e None None] Enqueued Resource ID: 98d1190f-d5fe-41fa-be13-56ba01cbf35a with Priority: HIGHEST for action port [ 703.387788] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98d1190f-d5fe-41fa-be13-56ba01cbf35a with Priority: HIGHEST for action port [ 703.388441] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-98d1190f-d5fe-41fa-be13-56ba01cbf35a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.388441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98d1190f-d5fe-41fa-be13-56ba01cbf35a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.388441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98d1190f-d5fe-41fa-be13-56ba01cbf35a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.388641] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98d1190f-d5fe-41fa-be13-56ba01cbf35a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.388641] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98d1190f-d5fe-41fa-be13-56ba01cbf35a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.508977] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 in Status: SUCCESS [ 703.509192] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622a5b07-14ae-44ec-94dd-57b4349034a7 deletion is rescheduled due to dependency. [ 703.509309] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622a5b07-14ae-44ec-94dd-57b4349034a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.606994] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d6d04fe-5c8f-429c-a53c-3624e93ccf17 [ 703.607481] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.607481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.607481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.607744] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.607744] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.607855] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d6d04fe-5c8f-429c-a53c-3624e93ccf17 already deleted. [ 703.607923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d6d04fe-5c8f-429c-a53c-3624e93ccf17" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.718099] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.718099] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.718099] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.718099] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.718099] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.718099] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port f47b3078-02c4-4038-890a-f5b09f136e31 not found, creating... [ 703.718099] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.718099] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.718099] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.718099] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.718670] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.718670] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.718670] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.718670] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.718670] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.718670] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.718670] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: f47b3078-02c4-4038-890a-f5b09f136e31 is going to be created. [ 703.739821] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.740049] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.740234] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.740452] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.740682] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.740908] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-f47b3078-02c4-4038-890a-f5b09f136e31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.891686] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98d1190f-d5fe-41fa-be13-56ba01cbf35a [ 703.892308] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.892308] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.892308] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.892637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.892637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.892637] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98d1190f-d5fe-41fa-be13-56ba01cbf35a already deleted. [ 703.892637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98d1190f-d5fe-41fa-be13-56ba01cbf35a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.442458] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: SUCCESS [ 704.442458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.442458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.442606] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.443059] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.443059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.443059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.443295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.443295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.443595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.443595] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.542591] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: SUCCESS [ 704.542705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.685425] env[71140]: INFO networking_nsxv3.common.synchronization [req-a800a38a-d2ab-4478-981b-250835307b56 req-12b15873-03b6-4abd-b05f-adceea622b32 service nova] Enqueued Resource ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 with Priority: HIGHEST for action security_group_rules [ 704.685944] env[71140]: INFO networking_nsxv3.common.synchronization [req-a800a38a-d2ab-4478-981b-250835307b56 req-12b15873-03b6-4abd-b05f-adceea622b32 service nova] Enqueued Resource ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 with Priority: HIGHEST for action security_group_members [ 704.685944] env[71140]: INFO networking_nsxv3.common.synchronization [req-a800a38a-d2ab-4478-981b-250835307b56 req-12b15873-03b6-4abd-b05f-adceea622b32 service nova] Enqueued Resource ID: f47b3078-02c4-4038-890a-f5b09f136e31 with Priority: HIGHEST for action port [ 704.686080] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 with Priority: HIGHEST for action security_group_rules [ 704.686247] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 with Priority: HIGHEST for action security_group_members [ 704.686353] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f47b3078-02c4-4038-890a-f5b09f136e31 with Priority: HIGHEST for action port [ 704.686903] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-604d5290-2f79-4d99-b6f1-1e0335d615a9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.687404] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.687777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.688037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.688111] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('604d5290-2f79-4d99-b6f1-1e0335d615a9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.689837] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-604d5290-2f79-4d99-b6f1-1e0335d615a9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.689962] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.690048] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.690410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.690731] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.690859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.690933] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.691257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.691257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.691257] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('604d5290-2f79-4d99-b6f1-1e0335d615a9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.694562] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-f47b3078-02c4-4038-890a-f5b09f136e31 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.694696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f47b3078-02c4-4038-890a-f5b09f136e31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.694745] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f47b3078-02c4-4038-890a-f5b09f136e31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.695076] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f47b3078-02c4-4038-890a-f5b09f136e31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.695076] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f47b3078-02c4-4038-890a-f5b09f136e31',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.706932] env[71140]: INFO networking_nsxv3.common.synchronization [req-68f56a53-7421-4624-bb59-69e668212712 req-68ae3992-ddee-4208-9562-4ab47ce6f283 tempest-ServersAdminNegativeTestJSON-368123288 tempest-ServersAdminNegativeTestJSON-368123288-project-member] Enqueued Resource ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 with Priority: HIGHEST for action security_group_members [ 704.707425] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 with Priority: HIGHEST for action security_group_members [ 704.708658] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-522bdeb8-3be1-4507-b2cc-adc33ff88371 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.708658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.708861] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.708909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.710306] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.710306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.710306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.710306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.710306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.710306] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.945870] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.946056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.946125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.946423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.946599] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.946700] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.946759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.946925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.947021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.947111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.947523] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.947523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.947523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.947644] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.947690] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.947856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.947856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.947959] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.950365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.950516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.950620] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.058077] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.058166] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.058276] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.058557] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.058956] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.059184] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.059312] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.059542] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.059715] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.059930] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.060067] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.060180] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.060290] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.060401] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.060506] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.060637] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.078827] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.079029] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 705.079155] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.079348] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.079702] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-f5c34d25-1329-419c-85f8-f065bbe224c3 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.079895] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-f5c34d25-1329-419c-85f8-f065bbe224c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.080048] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-f5c34d25-1329-419c-85f8-f065bbe224c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.080385] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-f5c34d25-1329-419c-85f8-f065bbe224c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.080528] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5c34d25-1329-419c-85f8-f065bbe224c3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.198019] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('604d5290-2f79-4d99-b6f1-1e0335d615a9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.198019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-604d5290-2f79-4d99-b6f1-1e0335d615a9 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.198019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.198388] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f47b3078-02c4-4038-890a-f5b09f136e31 with status ACTIVE [ 705.198629] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.198735] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.198797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.198999] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.199110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.199277] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.199371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.199430] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.199586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.199660] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.199829] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.199918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.199976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.200303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.200408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.200500] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f47b3078-02c4-4038-890a-f5b09f136e31 is going to be updated. [ 705.213670] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.223146] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.223146] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.223146] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.223383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.224263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.224263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f47b3078-02c4-4038-890a-f5b09f136e31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.453784] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 184bb91c-9526-466a-820b-ced20908d98e: rpc.has_security_group_logging(os_id): False [ 705.475793] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.475793] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.476039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.476166] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.476407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.476577] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.476685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.476756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.477131] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.477131] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.477319] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.477426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.477491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.477677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.477734] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.477908] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.478013] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.478077] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.478220] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.478296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.478440] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be updated. [ 705.548323] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.548531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.548608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.548895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.549098] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.563498] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: IN_PROGRESS for 2s [ 705.584978] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.585368] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.585511] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.586085] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.586163] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.586399] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port f5c34d25-1329-419c-85f8-f065bbe224c3 not found, creating... [ 705.586703] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.586913] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.587060] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.587726] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.587726] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.587862] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.588046] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.588167] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.588386] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.588526] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.588673] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: f5c34d25-1329-419c-85f8-f065bbe224c3 is going to be created. [ 705.618335] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.618535] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.618660] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.618938] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.619219] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.619476] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-f5c34d25-1329-419c-85f8-f065bbe224c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.703061] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('604d5290-2f79-4d99-b6f1-1e0335d615a9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.715813] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.208589] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.208589] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.208589] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.208589] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.208589] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.208589] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 is going to be created. [ 706.218708] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.218822] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.218822] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.219025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.219119] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.219219] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 is going to be updated. [ 706.243604] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.243604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.243604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.244258] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.244258] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.258599] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.258762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.258835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.259064] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.259210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.261860] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 in Status: UNINITIALIZED for 2s [ 706.270884] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 in Status: IN_PROGRESS for 2s [ 706.574731] env[71140]: INFO networking_nsxv3.common.synchronization [req-68f56a53-7421-4624-bb59-69e668212712 req-3e66f7d2-2fe0-4083-8fa2-812ba817584c service nova] Enqueued Resource ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 with Priority: HIGHEST for action security_group_rules [ 706.574731] env[71140]: INFO networking_nsxv3.common.synchronization [req-68f56a53-7421-4624-bb59-69e668212712 req-3e66f7d2-2fe0-4083-8fa2-812ba817584c service nova] Enqueued Resource ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 with Priority: HIGHEST for action security_group_members [ 706.574731] env[71140]: INFO networking_nsxv3.common.synchronization [req-68f56a53-7421-4624-bb59-69e668212712 req-3e66f7d2-2fe0-4083-8fa2-812ba817584c service nova] Enqueued Resource ID: f5c34d25-1329-419c-85f8-f065bbe224c3 with Priority: HIGHEST for action port [ 706.574731] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 with Priority: HIGHEST for action security_group_rules [ 706.574731] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 with Priority: HIGHEST for action security_group_members [ 706.574731] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5c34d25-1329-419c-85f8-f065bbe224c3 with Priority: HIGHEST for action port [ 706.574731] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-522bdeb8-3be1-4507-b2cc-adc33ff88371 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.574731] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.574731] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.575286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.575286] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.578591] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-522bdeb8-3be1-4507-b2cc-adc33ff88371 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.578591] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.578591] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5c34d25-1329-419c-85f8-f065bbe224c3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.578591] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5c34d25-1329-419c-85f8-f065bbe224c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.578591] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5c34d25-1329-419c-85f8-f065bbe224c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.578591] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5c34d25-1329-419c-85f8-f065bbe224c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.578591] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5c34d25-1329-419c-85f8-f065bbe224c3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.054156] env[71140]: INFO networking_nsxv3.common.synchronization [req-44025d04-0790-418c-9841-505e2b6a6ef7 req-f2d88da5-c23f-4007-875e-852d893f3b23 tempest-ServerAddressesNegativeTestJSON-721148734 tempest-ServerAddressesNegativeTestJSON-721148734-project-member] Enqueued Resource ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 with Priority: HIGHEST for action security_group_members [ 707.054700] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 with Priority: HIGHEST for action security_group_members [ 707.054998] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-083af43f-5ab0-4b05-a7bb-d6121e5f0390 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.055136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.055222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.055431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.055589] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.055716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.055783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.056280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.056384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.056488] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('083af43f-5ab0-4b05-a7bb-d6121e5f0390',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.080140] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-522bdeb8-3be1-4507-b2cc-adc33ff88371 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.080247] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.080418] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5c34d25-1329-419c-85f8-f065bbe224c3 with status ACTIVE [ 707.080583] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.080683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.080748] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.080927] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.081025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.081188] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.081283] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.081374] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.081491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.081560] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.081734] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.081827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.081888] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.082045] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.082120] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.082203] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5c34d25-1329-419c-85f8-f065bbe224c3 is going to be updated. [ 707.106152] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.106392] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.106469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.106616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.106752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.106907] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5c34d25-1329-419c-85f8-f065bbe224c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.558189] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.558369] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.558444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.558664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.558759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.558964] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.559080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.559142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.559296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.559375] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.559465] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 is going to be updated. [ 707.578154] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: SUCCESS [ 707.578386] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.586803] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.587137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.587425] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.587685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.587856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.605053] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 in Status: IN_PROGRESS for 2s [ 708.274450] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 in Status: SUCCESS [ 708.274450] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.274450] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.274450] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.274450] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.274450] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.274450] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.274450] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.274450] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.275108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.275108] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('604d5290-2f79-4d99-b6f1-1e0335d615a9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.282880] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 in Status: SUCCESS [ 708.283106] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.283260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.283468] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.283652] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.283766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.283831] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.283983] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.284091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.284399] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.777458] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('604d5290-2f79-4d99-b6f1-1e0335d615a9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.787083] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.803460] env[71140]: INFO networking_nsxv3.common.synchronization [req-dda67bb3-5fd7-492f-93df-325047548f7b req-e89da17c-b9c9-4b35-acfa-dc808308ae8f tempest-ImagesTestJSON-1376189349 tempest-ImagesTestJSON-1376189349-project-member] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 708.803967] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 708.804276] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.804397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.804518] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.805142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.805349] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.805486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.805588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.805852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.805954] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.806062] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.284754] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 604d5290-2f79-4d99-b6f1-1e0335d615a9: rpc.has_security_group_logging(os_id): False [ 709.290450] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.302341] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.302942] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.303162] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.305029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.305029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.305029] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.305029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.305029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.305029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.305029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.305029] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 is going to be created. [ 709.308224] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.308824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.310018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.310018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.310018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.310018] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.310018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.310018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.310018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.310018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.310018] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 already deleted. [ 709.310018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.378259] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.378259] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.378259] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.378259] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.378259] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.390200] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 in Status: IN_PROGRESS for 2s [ 709.568099] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-920 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.568099] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.568099] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.568099] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.568099] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.568099] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.569911] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.569911] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.569911] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.569911] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.569911] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.569911] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.569911] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.569911] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.569911] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.569911] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.591974] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.592174] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 709.592312] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.592945] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.592945] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-fffe6507-9ead-4564-b643-80e6a3889b97 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.593140] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-fffe6507-9ead-4564-b643-80e6a3889b97" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.593140] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-fffe6507-9ead-4564-b643-80e6a3889b97" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.593488] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-fffe6507-9ead-4564-b643-80e6a3889b97" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.593632] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fffe6507-9ead-4564-b643-80e6a3889b97',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.615278] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 in Status: SUCCESS [ 709.615278] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 083af43f-5ab0-4b05-a7bb-d6121e5f0390 deletion is rescheduled due to dependency. [ 709.615415] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-083af43f-5ab0-4b05-a7bb-d6121e5f0390" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.793260] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.793493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.793567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.793797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.793927] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.794221] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 is going to be updated. [ 709.832149] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.832301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.832366] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.835094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.835094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.843109] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 in Status: IN_PROGRESS for 2s [ 710.100335] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.100335] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.100335] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.100335] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.103159] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.103439] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port fffe6507-9ead-4564-b643-80e6a3889b97 not found, creating... [ 710.103987] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.103987] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.103987] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.104353] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.104576] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.104783] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.104946] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.105228] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.105494] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.105609] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.105773] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: fffe6507-9ead-4564-b643-80e6a3889b97 is going to be created. [ 710.127632] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.128520] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.128520] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.128520] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.128520] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.128815] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-fffe6507-9ead-4564-b643-80e6a3889b97" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.927735] env[71140]: INFO networking_nsxv3.common.synchronization [req-dda67bb3-5fd7-492f-93df-325047548f7b req-0876dff4-f17c-478b-8778-c8f302cfca05 service nova] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_rules [ 710.928065] env[71140]: INFO networking_nsxv3.common.synchronization [req-dda67bb3-5fd7-492f-93df-325047548f7b req-0876dff4-f17c-478b-8778-c8f302cfca05 service nova] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 710.928065] env[71140]: INFO networking_nsxv3.common.synchronization [req-dda67bb3-5fd7-492f-93df-325047548f7b req-0876dff4-f17c-478b-8778-c8f302cfca05 service nova] Enqueued Resource ID: fffe6507-9ead-4564-b643-80e6a3889b97 with Priority: HIGHEST for action port [ 710.928630] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_rules [ 710.928779] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 710.928935] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fffe6507-9ead-4564-b643-80e6a3889b97 with Priority: HIGHEST for action port [ 710.929383] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.929491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.929542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.929787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.929932] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.930786] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.930920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.930990] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.931186] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.931340] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.931438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.931498] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.932056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.932056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.932056] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.932865] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-fffe6507-9ead-4564-b643-80e6a3889b97 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.932975] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fffe6507-9ead-4564-b643-80e6a3889b97" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.932975] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fffe6507-9ead-4564-b643-80e6a3889b97" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.933108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fffe6507-9ead-4564-b643-80e6a3889b97" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.933503] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fffe6507-9ead-4564-b643-80e6a3889b97',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.402465] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 in Status: SUCCESS [ 711.402555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.434613] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.434756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.434972] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.436933] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fffe6507-9ead-4564-b643-80e6a3889b97 with status ACTIVE [ 711.441704] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.441704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.441704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.441704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.441704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.441704] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.441704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.441704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.442039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.442039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.442406] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.442406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.442595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.442595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.442689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.442744] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fffe6507-9ead-4564-b643-80e6a3889b97 is going to be updated. [ 711.464913] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.464913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.464913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.465238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.465238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.465381] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fffe6507-9ead-4564-b643-80e6a3889b97" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.510528] env[71140]: INFO networking_nsxv3.common.synchronization [None req-3fdfeea4-e6cd-4072-b685-63d4185ad1c9 None None] Enqueued Resource ID: c64281fb-591b-4a7a-8647-ff6257573eff with Priority: HIGHEST for action port [ 711.510528] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c64281fb-591b-4a7a-8647-ff6257573eff with Priority: HIGHEST for action port [ 711.510528] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-c64281fb-591b-4a7a-8647-ff6257573eff taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.510528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c64281fb-591b-4a7a-8647-ff6257573eff" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.510528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c64281fb-591b-4a7a-8647-ff6257573eff" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.510909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c64281fb-591b-4a7a-8647-ff6257573eff" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.512702] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c64281fb-591b-4a7a-8647-ff6257573eff',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.854729] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 in Status: SUCCESS [ 711.854729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.854729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.854729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.854729] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.854729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.854729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.854729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.854729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.854729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.855340] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.937928] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.016416] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c64281fb-591b-4a7a-8647-ff6257573eff [ 712.016664] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.016796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.016885] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.017152] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.017267] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.017355] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c64281fb-591b-4a7a-8647-ff6257573eff already deleted. [ 712.017420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c64281fb-591b-4a7a-8647-ff6257573eff" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.360920] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-522bdeb8-3be1-4507-b2cc-adc33ff88371 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.360920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.360920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.361102] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.361566] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.361707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.361770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.365322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.365322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.365322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.365322] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-522bdeb8-3be1-4507-b2cc-adc33ff88371 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.365322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.365322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.365322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.365322] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.365322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.365322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.365322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.365322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.365322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.365322] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.445405] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.445621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.445801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.445903] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.445992] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.446137] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be created. [ 712.470628] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.470791] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.471245] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.471245] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.471384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.482548] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: UNINITIALIZED for 2s [ 712.753365] env[71140]: INFO networking_nsxv3.common.synchronization [req-d02db676-29c4-45d2-8eb2-8d0f021329a7 req-b99a4eee-7f30-4edf-a96d-d28e3744322e tempest-ServerDiskConfigTestJSON-63292790 tempest-ServerDiskConfigTestJSON-63292790-project-member] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 712.753909] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 712.754277] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.754479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.754552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.754812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.754983] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.757095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.757095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.757095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.757095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.757095] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.866585] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 522bdeb8-3be1-4507-b2cc-adc33ff88371: rpc.has_security_group_logging(os_id): False [ 712.886573] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.886573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.886573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.886573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.886573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.886573] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.886573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.886573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.886573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.886573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.886573] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.886573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.886573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.887131] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.887131] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.887131] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.889402] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.889402] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.889531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.889623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.889725] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 is going to be updated. [ 712.952176] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.952525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.952525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.953360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.953360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.979231] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 in Status: IN_PROGRESS for 2s [ 713.208247] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.208467] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.208570] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.208916] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.209201] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.209381] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.210715] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.210715] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.210715] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.210715] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.210715] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.210715] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.210715] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.210715] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.210715] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.210715] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.237242] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.237514] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.237656] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.237892] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.238161] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-03741e30-1ac6-4033-97ad-4fe47bb8ee15 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.238847] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-03741e30-1ac6-4033-97ad-4fe47bb8ee15" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.238847] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-03741e30-1ac6-4033-97ad-4fe47bb8ee15" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.238847] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-03741e30-1ac6-4033-97ad-4fe47bb8ee15" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.239011] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03741e30-1ac6-4033-97ad-4fe47bb8ee15',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.261243] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.261243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.261243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.261243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.261243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.261243] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.261243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.261243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.261243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.261243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.261243] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 already deleted. [ 713.261243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.701988] env[71140]: INFO networking_nsxv3.common.synchronization [None req-5cfedc85-5540-493f-81ec-6082f79650c3 None None] Enqueued Resource ID: ddaa8b3d-057a-4f13-bd01-15693a2bd588 with Priority: HIGHEST for action port [ 713.702635] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddaa8b3d-057a-4f13-bd01-15693a2bd588 with Priority: HIGHEST for action port [ 713.703056] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddaa8b3d-057a-4f13-bd01-15693a2bd588 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.703203] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddaa8b3d-057a-4f13-bd01-15693a2bd588" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.703275] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddaa8b3d-057a-4f13-bd01-15693a2bd588" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.703568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddaa8b3d-057a-4f13-bd01-15693a2bd588" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.703656] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddaa8b3d-057a-4f13-bd01-15693a2bd588',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.742015] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.742150] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.742264] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.742558] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.742704] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.742860] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 03741e30-1ac6-4033-97ad-4fe47bb8ee15 not found, creating... [ 713.744211] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.744211] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.744211] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.744211] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.744211] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.744211] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.744211] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.744567] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.744567] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.744647] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.744732] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 03741e30-1ac6-4033-97ad-4fe47bb8ee15 is going to be created. [ 713.768408] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.768566] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.768692] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.769008] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.769254] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.769501] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-03741e30-1ac6-4033-97ad-4fe47bb8ee15" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.207563] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddaa8b3d-057a-4f13-bd01-15693a2bd588 [ 714.209101] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.209101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.209101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.209101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.209101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.209101] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddaa8b3d-057a-4f13-bd01-15693a2bd588 already deleted. [ 714.209101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddaa8b3d-057a-4f13-bd01-15693a2bd588" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.493110] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 714.493935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.494257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.494433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.494627] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.494735] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.494806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.494960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.495049] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.495175] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.495233] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.738205] env[71140]: INFO networking_nsxv3.common.synchronization [req-d02db676-29c4-45d2-8eb2-8d0f021329a7 req-a21bc2e7-624b-426b-bdea-361a2dd15e88 service nova] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_rules [ 714.738368] env[71140]: INFO networking_nsxv3.common.synchronization [req-d02db676-29c4-45d2-8eb2-8d0f021329a7 req-a21bc2e7-624b-426b-bdea-361a2dd15e88 service nova] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 714.738500] env[71140]: INFO networking_nsxv3.common.synchronization [req-d02db676-29c4-45d2-8eb2-8d0f021329a7 req-a21bc2e7-624b-426b-bdea-361a2dd15e88 service nova] Enqueued Resource ID: 03741e30-1ac6-4033-97ad-4fe47bb8ee15 with Priority: HIGHEST for action port [ 714.738728] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_rules [ 714.738850] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 714.738941] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03741e30-1ac6-4033-97ad-4fe47bb8ee15 with Priority: HIGHEST for action port [ 714.739519] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.739638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.739703] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.739957] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.740050] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.742261] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.742261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.742261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.742261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.742261] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.742261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.742261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.742261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.742261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.742261] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.747051] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-03741e30-1ac6-4033-97ad-4fe47bb8ee15 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.747215] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03741e30-1ac6-4033-97ad-4fe47bb8ee15" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.747215] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03741e30-1ac6-4033-97ad-4fe47bb8ee15" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.747895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03741e30-1ac6-4033-97ad-4fe47bb8ee15" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.747895] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03741e30-1ac6-4033-97ad-4fe47bb8ee15',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.999516] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.999724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.999824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.000089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.000295] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.000426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.000513] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.000706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.000822] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.000938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.001143] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.001268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.001356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.001529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.001697] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.001795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.001872] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.002062] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.002171] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.002282] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.002395] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.019224] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 in Status: SUCCESS [ 715.019452] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.249090] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.254742] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.254871] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.255090] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03741e30-1ac6-4033-97ad-4fe47bb8ee15 with status ACTIVE [ 715.255266] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.255384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.255445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.255656] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.255749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.255924] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.256194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.256194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.256361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.256398] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.256624] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.256727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.256790] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.256940] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.257029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.257130] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03741e30-1ac6-4033-97ad-4fe47bb8ee15 is going to be updated. [ 715.281602] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.281602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.281602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.281602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.281602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.281602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03741e30-1ac6-4033-97ad-4fe47bb8ee15" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.511058] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43a772d0-e00d-4627-ad2d-c6c3ccbcee06: rpc.has_security_group_logging(os_id): False [ 715.539111] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.539111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.539111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.539111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.539111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.539265] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.539610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.539610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.545429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.545429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.545429] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.545429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.545429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.545429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.545429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.545429] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.545429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.545429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.545429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.545429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.545429] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be created. [ 715.606179] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.607572] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.607572] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.609785] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.615452] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.630226] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 715.754894] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.266183] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.266503] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.266503] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.266701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.266791] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.267246] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be created. [ 716.297031] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.297031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.297031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.297031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.297031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.304801] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: UNINITIALIZED for 2s [ 717.642443] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 717.642742] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.742248] env[71140]: INFO networking_nsxv3.common.synchronization [None req-3daa2eb6-ff8b-4ac7-9d26-aaf41c7b2d06 None None] Enqueued Resource ID: 19acf862-c663-472f-8ea3-3345cbc754b8 with Priority: HIGHEST for action port [ 717.742248] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19acf862-c663-472f-8ea3-3345cbc754b8 with Priority: HIGHEST for action port [ 717.742248] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-19acf862-c663-472f-8ea3-3345cbc754b8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.742248] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19acf862-c663-472f-8ea3-3345cbc754b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.742248] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19acf862-c663-472f-8ea3-3345cbc754b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.742248] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19acf862-c663-472f-8ea3-3345cbc754b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.742248] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19acf862-c663-472f-8ea3-3345cbc754b8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.242823] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19acf862-c663-472f-8ea3-3345cbc754b8 [ 718.243092] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.243236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.243301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.243517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.243610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.243705] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19acf862-c663-472f-8ea3-3345cbc754b8 already deleted. [ 718.243785] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19acf862-c663-472f-8ea3-3345cbc754b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.318046] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 718.318279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.318443] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.318692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.318896] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.319110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.319110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.319255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.319339] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.319430] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.319527] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.821712] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.822133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.822133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.824186] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.824447] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.824571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.824634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.824822] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.824912] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.825032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.826028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.826028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.826028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.826028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.826028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.826028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.826028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.826028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.826321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.826321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.826321] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.329215] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2975c43-5d19-4643-8076-5d24f0ea84c6: rpc.has_security_group_logging(os_id): False [ 719.350103] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.350103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.350103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.350103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.350103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.350103] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.350103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.350103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.350400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.350400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.350550] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.350623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.350668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.350819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.350910] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.351870] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.352130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.352130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.352240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.352370] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.352498] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be created. [ 719.409402] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.410098] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.410098] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.412018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.412018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.425036] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 719.786082] env[71140]: INFO networking_nsxv3.common.synchronization [None req-892ce2a3-b605-4e83-90f4-225740e0e7c3 None None] Enqueued Resource ID: 41829544-fad5-4505-9ee0-9d330918a5c6 with Priority: HIGHEST for action port [ 719.786391] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41829544-fad5-4505-9ee0-9d330918a5c6 with Priority: HIGHEST for action port [ 719.786912] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-41829544-fad5-4505-9ee0-9d330918a5c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.787054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41829544-fad5-4505-9ee0-9d330918a5c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.787122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41829544-fad5-4505-9ee0-9d330918a5c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.791016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41829544-fad5-4505-9ee0-9d330918a5c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.791016] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41829544-fad5-4505-9ee0-9d330918a5c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.289966] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41829544-fad5-4505-9ee0-9d330918a5c6 [ 720.290256] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.290410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.290441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.290633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.290719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.291056] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41829544-fad5-4505-9ee0-9d330918a5c6 already deleted. [ 720.291056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41829544-fad5-4505-9ee0-9d330918a5c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.385017] env[71140]: INFO networking_nsxv3.common.synchronization [req-cd1fbd89-e455-43ee-9d43-57e09e77dea5 req-df22635b-f8a2-4cda-9f0e-31fd0a3883ae tempest-ListServerFiltersTestJSON-1641915528 tempest-ListServerFiltersTestJSON-1641915528-project-member] Enqueued Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 720.385112] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 720.385379] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.385496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.385560] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.385809] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.385968] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.387539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.387539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.387539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.387744] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.387841] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.774738] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-693 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.774993] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-693" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.775152] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-693" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.775473] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-693" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.775748] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.776438] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.776438] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.776438] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.776609] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.776821] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.776974] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.777084] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.777189] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.777300] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.777427] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.777558] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.796222] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.796967] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 720.796967] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.796967] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-693" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.797253] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-34def748-924d-428d-b0f3-640e54edc007 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.797389] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-34def748-924d-428d-b0f3-640e54edc007" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.797512] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-34def748-924d-428d-b0f3-640e54edc007" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.797820] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-34def748-924d-428d-b0f3-640e54edc007" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.797964] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34def748-924d-428d-b0f3-640e54edc007',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.891534] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.891694] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.891797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.892248] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.892248] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.892452] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.892452] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.892452] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.892641] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.892702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.892770] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 already deleted. [ 720.892848] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.301126] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.301442] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.301442] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.301715] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.301872] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.302043] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 34def748-924d-428d-b0f3-640e54edc007 not found, creating... [ 721.302317] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.302468] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.302951] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.302951] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.303102] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.303589] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.303589] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.303796] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.303913] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.304038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.304192] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 34def748-924d-428d-b0f3-640e54edc007 is going to be created. [ 721.322647] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.322872] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.322995] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.323290] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.323522] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.323760] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-34def748-924d-428d-b0f3-640e54edc007" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.438507] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 721.438750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.074940] env[71140]: INFO networking_nsxv3.common.synchronization [req-cd1fbd89-e455-43ee-9d43-57e09e77dea5 req-386f5db6-545d-4afd-95a3-94a6ab98d70c service nova] Enqueued Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_rules [ 722.075192] env[71140]: INFO networking_nsxv3.common.synchronization [req-cd1fbd89-e455-43ee-9d43-57e09e77dea5 req-386f5db6-545d-4afd-95a3-94a6ab98d70c service nova] Enqueued Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 722.075291] env[71140]: INFO networking_nsxv3.common.synchronization [req-cd1fbd89-e455-43ee-9d43-57e09e77dea5 req-386f5db6-545d-4afd-95a3-94a6ab98d70c service nova] Enqueued Resource ID: 34def748-924d-428d-b0f3-640e54edc007 with Priority: HIGHEST for action port [ 722.075527] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_rules [ 722.075664] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 722.075761] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34def748-924d-428d-b0f3-640e54edc007 with Priority: HIGHEST for action port [ 722.076435] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.076606] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.076695] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.077053] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.077180] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.078065] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.078265] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.078387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.078615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.078819] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.078963] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.079024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.079206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.079321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.079437] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.083031] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-34def748-924d-428d-b0f3-640e54edc007 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.083379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34def748-924d-428d-b0f3-640e54edc007" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.083379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34def748-924d-428d-b0f3-640e54edc007" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.083713] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34def748-924d-428d-b0f3-640e54edc007" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.083713] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34def748-924d-428d-b0f3-640e54edc007',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.585522] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.585988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.587734] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.587734] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34def748-924d-428d-b0f3-640e54edc007 with status ACTIVE [ 722.587734] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.587924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.587924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.588452] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.588452] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.588452] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.588686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.588686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.589091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.589091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.589091] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.589572] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.589665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.589832] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.590126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.590126] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34def748-924d-428d-b0f3-640e54edc007 is going to be updated. [ 722.616459] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.616842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.616842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.617657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.617657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.617657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34def748-924d-428d-b0f3-640e54edc007" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.092361] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.597625] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.597880] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.597880] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.598257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.598322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.598419] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 is going to be created. [ 723.636524] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.636893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.636893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.637017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.637138] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.648815] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: UNINITIALIZED for 2s [ 723.717916] env[71140]: INFO networking_nsxv3.common.synchronization [req-d29b4aef-3e98-43be-a836-c5336ab90382 req-670ac6f6-5c2e-4461-aef0-6cc55c46d092 tempest-ServersAdminNegativeTestJSON-368123288 tempest-ServersAdminNegativeTestJSON-368123288-project-member] Enqueued Resource ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 with Priority: HIGHEST for action security_group_members [ 723.717916] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 with Priority: HIGHEST for action security_group_members [ 723.717916] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-522bdeb8-3be1-4507-b2cc-adc33ff88371 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.717916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.717916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.718244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.718415] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.718516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.719482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.719704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.719798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.719900] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.223222] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.243432] env[71140]: INFO networking_nsxv3.common.synchronization [None req-f3699e87-7d18-4059-b1c9-ebda638af811 None None] Enqueued Resource ID: 73516cc1-d3e2-461c-888a-5c7c02b7a25f with Priority: HIGHEST for action port [ 724.243969] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73516cc1-d3e2-461c-888a-5c7c02b7a25f with Priority: HIGHEST for action port [ 724.245136] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-73516cc1-d3e2-461c-888a-5c7c02b7a25f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.245136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73516cc1-d3e2-461c-888a-5c7c02b7a25f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.245136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73516cc1-d3e2-461c-888a-5c7c02b7a25f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.246511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73516cc1-d3e2-461c-888a-5c7c02b7a25f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.246511] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73516cc1-d3e2-461c-888a-5c7c02b7a25f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.727086] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.750012] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73516cc1-d3e2-461c-888a-5c7c02b7a25f [ 724.750012] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.750012] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.750012] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.750222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.750222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.750275] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73516cc1-d3e2-461c-888a-5c7c02b7a25f already deleted. [ 724.750346] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73516cc1-d3e2-461c-888a-5c7c02b7a25f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.227723] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.228197] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.228387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.228683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.228883] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.229173] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 is going to be updated. [ 725.260479] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.260634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.260709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.260915] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.261075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.272143] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 in Status: IN_PROGRESS for 2s [ 725.507013] env[71140]: INFO networking_nsxv3.common.synchronization [req-a4631127-33c7-433c-84b6-ec0c8d176657 req-c42f74b7-8470-407d-9918-21152ff35571 tempest-ListServerFiltersTestJSON-1641915528 tempest-ListServerFiltersTestJSON-1641915528-project-member] Enqueued Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 725.507013] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 725.507013] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.507013] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.661446] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: SUCCESS [ 725.661681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.661852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.662095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.662291] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.662408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.662476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.662638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.662716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.662801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.662903] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.664441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.664629] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.664791] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.665670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.665670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.665670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.665670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.665670] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.050999] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-693 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.051408] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-693" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.051408] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-693" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.051673] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-693" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.051972] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.052178] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.052303] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.052559] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.052721] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.052953] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.053097] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.053217] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.053342] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.053464] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.053589] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.053728] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.072450] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.072637] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 726.072897] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.073035] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-693" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.073319] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-949c63d6-d73f-43eb-b37f-954ffc613ec0 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.073489] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-949c63d6-d73f-43eb-b37f-954ffc613ec0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.074131] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-949c63d6-d73f-43eb-b37f-954ffc613ec0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.074131] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-949c63d6-d73f-43eb-b37f-954ffc613ec0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.074131] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('949c63d6-d73f-43eb-b37f-954ffc613ec0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.172032] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.172032] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.172032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.488293] env[71140]: INFO networking_nsxv3.common.synchronization [None req-79a5e7f6-2522-4bd7-b4d9-0b6e52d3fe23 None None] Enqueued Resource ID: b2c83ae0-1704-4ccd-8959-0a596d158610 with Priority: HIGHEST for action port [ 726.488569] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2c83ae0-1704-4ccd-8959-0a596d158610 with Priority: HIGHEST for action port [ 726.490417] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2c83ae0-1704-4ccd-8959-0a596d158610 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.490417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2c83ae0-1704-4ccd-8959-0a596d158610" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.490417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2c83ae0-1704-4ccd-8959-0a596d158610" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.490417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2c83ae0-1704-4ccd-8959-0a596d158610" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.490417] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2c83ae0-1704-4ccd-8959-0a596d158610',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.576150] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.576544] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.576739] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.577073] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.577347] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.577582] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 949c63d6-d73f-43eb-b37f-954ffc613ec0 not found, creating... [ 726.577897] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.578132] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.578321] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.579434] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.579434] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.579434] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.579679] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.579848] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.580124] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.580324] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.580518] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 949c63d6-d73f-43eb-b37f-954ffc613ec0 is going to be created. [ 726.600479] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.600479] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.600479] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.600709] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.601052] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.601344] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-949c63d6-d73f-43eb-b37f-954ffc613ec0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.671463] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.992927] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2c83ae0-1704-4ccd-8959-0a596d158610 [ 726.993267] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.993370] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.993413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.993671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.993794] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.993898] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2c83ae0-1704-4ccd-8959-0a596d158610 already deleted. [ 726.993986] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2c83ae0-1704-4ccd-8959-0a596d158610" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.174121] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.174448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.174448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.174570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.174665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.174769] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 is going to be updated. [ 727.221335] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.221491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.221568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.221764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.221906] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.235180] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: IN_PROGRESS for 2s [ 727.283083] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 in Status: SUCCESS [ 727.283766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.367095] env[71140]: INFO networking_nsxv3.common.synchronization [req-a4631127-33c7-433c-84b6-ec0c8d176657 req-57411adf-b541-4c90-b8b5-c680be74a1c1 service nova] Enqueued Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_rules [ 727.367095] env[71140]: INFO networking_nsxv3.common.synchronization [req-a4631127-33c7-433c-84b6-ec0c8d176657 req-57411adf-b541-4c90-b8b5-c680be74a1c1 service nova] Enqueued Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 727.367095] env[71140]: INFO networking_nsxv3.common.synchronization [req-a4631127-33c7-433c-84b6-ec0c8d176657 req-57411adf-b541-4c90-b8b5-c680be74a1c1 service nova] Enqueued Resource ID: 949c63d6-d73f-43eb-b37f-954ffc613ec0 with Priority: HIGHEST for action port [ 727.367095] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_rules [ 727.367095] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 727.367095] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 949c63d6-d73f-43eb-b37f-954ffc613ec0 with Priority: HIGHEST for action port [ 727.367095] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.367095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.367095] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.367095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.367095] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-949c63d6-d73f-43eb-b37f-954ffc613ec0 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.367907] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-949c63d6-d73f-43eb-b37f-954ffc613ec0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.368541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-949c63d6-d73f-43eb-b37f-954ffc613ec0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.368675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-949c63d6-d73f-43eb-b37f-954ffc613ec0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.370170] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('949c63d6-d73f-43eb-b37f-954ffc613ec0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.874815] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 949c63d6-d73f-43eb-b37f-954ffc613ec0 with status ACTIVE [ 727.874815] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.874815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.874815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.874815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.874815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.874815] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.874815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.875132] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.875405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.875530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.875742] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.875843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.875918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.876117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.876196] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.876286] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 949c63d6-d73f-43eb-b37f-954ffc613ec0 is going to be updated. [ 727.898970] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.899235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.899355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.899612] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.899868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.900057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-949c63d6-d73f-43eb-b37f-954ffc613ec0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.906596] env[71140]: INFO networking_nsxv3.common.synchronization [req-ec7ed083-6af1-41cb-844c-50f1bec02eed req-b0112581-a3af-4415-94da-7a8c2368e4d4 tempest-ListServerFiltersTestJSON-1641915528 tempest-ListServerFiltersTestJSON-1641915528-project-member] Enqueued Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 727.910461] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 727.910461] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.910461] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.337630] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-693 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.337941] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-693" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.337941] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-693" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.339052] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-693" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.339052] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.339052] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.339052] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.339052] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.339305] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.339334] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.339439] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.339545] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.339648] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.339793] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.339910] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.340051] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.370064] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.370356] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 728.371079] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.371079] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-693" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.371079] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-16beee59-4df0-4d1e-976c-a768b20078fc taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.371301] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-16beee59-4df0-4d1e-976c-a768b20078fc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.371301] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-16beee59-4df0-4d1e-976c-a768b20078fc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.371625] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-16beee59-4df0-4d1e-976c-a768b20078fc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.371758] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16beee59-4df0-4d1e-976c-a768b20078fc',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.874028] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.874258] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.874404] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.874685] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.874835] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.874990] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 16beee59-4df0-4d1e-976c-a768b20078fc not found, creating... [ 728.875350] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.875509] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.875629] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.875844] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.875981] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.876277] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.876455] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.876577] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.876789] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.876922] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.877078] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 16beee59-4df0-4d1e-976c-a768b20078fc is going to be created. [ 728.896719] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.896891] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.897021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.897241] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.897458] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.897671] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-16beee59-4df0-4d1e-976c-a768b20078fc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.245328] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: SUCCESS [ 729.245605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.245852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.246078] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.246277] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.246414] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.246486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.246649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.246732] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.246821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.246983] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.247081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.247141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.247285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.247422] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.247515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.247574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.247713] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.247786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.247866] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.247959] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.248877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.249158] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.249298] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.249419] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.249501] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.249677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.249786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.249890] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.658955] env[71140]: INFO networking_nsxv3.common.synchronization [req-ec7ed083-6af1-41cb-844c-50f1bec02eed req-756f8936-6145-42a0-9606-1ce2a90c0be6 service nova] Enqueued Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_rules [ 729.658955] env[71140]: INFO networking_nsxv3.common.synchronization [req-ec7ed083-6af1-41cb-844c-50f1bec02eed req-756f8936-6145-42a0-9606-1ce2a90c0be6 service nova] Enqueued Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 729.658955] env[71140]: INFO networking_nsxv3.common.synchronization [req-ec7ed083-6af1-41cb-844c-50f1bec02eed req-756f8936-6145-42a0-9606-1ce2a90c0be6 service nova] Enqueued Resource ID: 16beee59-4df0-4d1e-976c-a768b20078fc with Priority: HIGHEST for action port [ 729.660092] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_rules [ 729.660183] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 729.660340] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16beee59-4df0-4d1e-976c-a768b20078fc with Priority: HIGHEST for action port [ 729.660586] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.660742] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.660889] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.660966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.661222] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-16beee59-4df0-4d1e-976c-a768b20078fc taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.661316] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16beee59-4df0-4d1e-976c-a768b20078fc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.661316] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16beee59-4df0-4d1e-976c-a768b20078fc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.661562] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16beee59-4df0-4d1e-976c-a768b20078fc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.661635] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16beee59-4df0-4d1e-976c-a768b20078fc',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.752406] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597: rpc.has_security_group_logging(os_id): False [ 729.754813] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.775048] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.775241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.775343] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.775600] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.775731] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.776508] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.776508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.776508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.776508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.776508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.777293] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.777293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.777293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.777293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.777293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.777562] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.777712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.777823] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.778031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.778273] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.778397] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 is going to be created. [ 729.857689] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.857840] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.858616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.861558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.861558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.874126] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: IN_PROGRESS for 2s [ 730.165097] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16beee59-4df0-4d1e-976c-a768b20078fc with status ACTIVE [ 730.165444] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.165650] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.165730] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.165994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.166139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.166379] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.166505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.166657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.166856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.167081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.167395] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.167509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.167545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.167743] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.167846] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.167959] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16beee59-4df0-4d1e-976c-a768b20078fc is going to be updated. [ 730.200883] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.201052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.201114] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.204183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.204183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.204183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16beee59-4df0-4d1e-976c-a768b20078fc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.257575] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.677999] env[71140]: INFO networking_nsxv3.common.synchronization [None req-38a70b44-e9b7-47f0-950b-b0ea8ba5bc98 tempest-MigrationsAdminTest-2143534678 tempest-MigrationsAdminTest-2143534678-project-member] Enqueued Resource ID: 17521770-9d79-4432-a7b0-1850474884c1 with Priority: HIGHEST for action security_group_rules [ 730.678315] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17521770-9d79-4432-a7b0-1850474884c1 with Priority: HIGHEST for action security_group_rules [ 730.678673] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17521770-9d79-4432-a7b0-1850474884c1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.678927] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17521770-9d79-4432-a7b0-1850474884c1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.679020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17521770-9d79-4432-a7b0-1850474884c1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.679281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17521770-9d79-4432-a7b0-1850474884c1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.679383] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17521770-9d79-4432-a7b0-1850474884c1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.763851] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.763851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.763851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.763851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.763851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.763851] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 is going to be updated. [ 730.769295] env[71140]: INFO networking_nsxv3.common.synchronization [None req-aceb94f1-d3ac-4079-84a6-eee5bda9bd45 tempest-MigrationsAdminTest-2143534678 tempest-MigrationsAdminTest-2143534678-project-member] Enqueued Resource ID: 17521770-9d79-4432-a7b0-1850474884c1 with Priority: HIGHEST for action security_group_rules [ 730.769844] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17521770-9d79-4432-a7b0-1850474884c1 with Priority: HIGHEST for action security_group_rules [ 730.770255] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17521770-9d79-4432-a7b0-1850474884c1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.770255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17521770-9d79-4432-a7b0-1850474884c1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.793829] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.793829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.793829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.793829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.793829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.802588] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: IN_PROGRESS for 2s [ 731.207358] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.207548] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.207645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.207896] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.208030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.208154] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17521770-9d79-4432-a7b0-1850474884c1 already deleted. [ 731.208286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17521770-9d79-4432-a7b0-1850474884c1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.208467] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17521770-9d79-4432-a7b0-1850474884c1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.208679] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17521770-9d79-4432-a7b0-1850474884c1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.208806] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17521770-9d79-4432-a7b0-1850474884c1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.730852] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.730852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.730852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.730852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.730852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.730852] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17521770-9d79-4432-a7b0-1850474884c1 already deleted. [ 731.730852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17521770-9d79-4432-a7b0-1850474884c1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.887466] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: SUCCESS [ 731.887588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.887718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.887941] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.888057] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.390625] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.390778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.812679] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: SUCCESS [ 732.812933] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.813175] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.813411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.813605] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.813741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.813809] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.813966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.814063] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.814160] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.318134] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.819046] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.322894] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.323218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.323218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.323400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.323496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.323602] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 is going to be updated. [ 734.354510] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.355110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.355110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.355110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.355291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.364700] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: IN_PROGRESS for 2s [ 735.776022] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 735.776022] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 736.134332] env[71140]: INFO networking_nsxv3.common.synchronization [req-0dc7339a-55b2-4914-bd3f-edde93453584 req-7167d69a-10d4-4229-8fd1-818f842b2780 tempest-ServerDiskConfigTestJSON-63292790 tempest-ServerDiskConfigTestJSON-63292790-project-member] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 736.134332] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 736.134332] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.134332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.134332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.135260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.135561] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.139197] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.139474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.139837] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.141623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.141623] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.375075] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: SUCCESS [ 736.375238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.375413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.375641] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.375825] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.375946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.376025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.376180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.376265] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.376372] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.644946] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.645161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.645246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.646696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.646696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.646696] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.646696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.646696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.646696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.646696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.646696] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 736.675316] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.675487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.675538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.675747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.675894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.684096] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 736.878264] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.382327] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.886405] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.886405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.886405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.886405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.886405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.886405] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 is going to be updated. [ 737.917020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.917020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.917020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.917020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.917020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.924851] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: IN_PROGRESS for 2s [ 737.949206] env[71140]: INFO networking_nsxv3.common.synchronization [req-07534686-843c-47a0-99d1-0f2a9c301ab1 req-5de4662e-34e2-45c5-b5d9-c94fd773c766 tempest-ListServersNegativeTestJSON-2012900449 tempest-ListServersNegativeTestJSON-2012900449-project-member] Enqueued Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 737.949206] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 737.949206] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.949206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.949206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.949909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.950278] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.952145] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.952145] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.952145] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.952145] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.952145] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.326344] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.326631] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-428" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.326819] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-428" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.327330] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-428" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.327742] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.327976] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.328164] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.328483] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.328701] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.329017] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.329954] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.330187] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.330360] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.330529] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.330691] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.331318] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.351329] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.351522] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 738.351670] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.351845] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-428" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.352198] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-d7dea745-a175-4b35-be11-632b67360954 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.352364] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-d7dea745-a175-4b35-be11-632b67360954" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.352480] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-d7dea745-a175-4b35-be11-632b67360954" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.352817] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-d7dea745-a175-4b35-be11-632b67360954" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.352987] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7dea745-a175-4b35-be11-632b67360954',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.453165] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.453554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.453554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.453855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.454036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.454355] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.454536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.454623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.454849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.454981] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.455198] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 already deleted. [ 738.455271] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.698393] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 738.698586] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 deletion is rescheduled due to dependency. [ 738.698711] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.855254] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.855544] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.855694] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.855992] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.856183] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.856497] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port d7dea745-a175-4b35-be11-632b67360954 not found, creating... [ 738.856835] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.857015] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.857147] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.857399] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.857539] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.857840] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.857999] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.858707] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.859030] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.859237] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.859437] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: d7dea745-a175-4b35-be11-632b67360954 is going to be created. [ 738.881204] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.881427] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.881555] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.881821] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.882063] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.882313] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-d7dea745-a175-4b35-be11-632b67360954" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.278024] env[71140]: INFO networking_nsxv3.common.synchronization [req-64191211-b59d-44b4-9e80-e605f9afec24 req-1cdc7299-1125-4e34-902a-c47730c5287c tempest-ImagesTestJSON-1376189349 tempest-ImagesTestJSON-1376189349-project-member] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 739.278968] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 739.279466] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.279571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.279603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.279808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.280785] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.281016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.281138] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.282998] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.283209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.283374] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.629963] env[71140]: INFO networking_nsxv3.common.synchronization [req-07534686-843c-47a0-99d1-0f2a9c301ab1 req-ef88089f-3723-46cf-8f95-d14f0648501a service nova] Enqueued Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_rules [ 739.630165] env[71140]: INFO networking_nsxv3.common.synchronization [req-07534686-843c-47a0-99d1-0f2a9c301ab1 req-ef88089f-3723-46cf-8f95-d14f0648501a service nova] Enqueued Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 739.630303] env[71140]: INFO networking_nsxv3.common.synchronization [req-07534686-843c-47a0-99d1-0f2a9c301ab1 req-ef88089f-3723-46cf-8f95-d14f0648501a service nova] Enqueued Resource ID: d7dea745-a175-4b35-be11-632b67360954 with Priority: HIGHEST for action port [ 739.630536] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_rules [ 739.630665] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 739.630761] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7dea745-a175-4b35-be11-632b67360954 with Priority: HIGHEST for action port [ 739.631404] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.631528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.631596] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.631859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.631942] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.632760] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.632902] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.632975] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.633157] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.633303] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.633394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.633458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.633628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.633718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.633804] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.634606] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7dea745-a175-4b35-be11-632b67360954 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.634755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7dea745-a175-4b35-be11-632b67360954" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.634826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7dea745-a175-4b35-be11-632b67360954" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.634983] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7dea745-a175-4b35-be11-632b67360954" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.635071] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7dea745-a175-4b35-be11-632b67360954',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.785967] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.786142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.786215] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.786471] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.786596] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.786771] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.787097] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.787097] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.787097] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.787243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.787243] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be updated. [ 739.814964] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.814964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.814964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.815161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.815161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.827802] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 739.936882] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: SUCCESS [ 739.937446] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.937446] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.937573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.937704] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.937819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.937886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.938048] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.938133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.938221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.938315] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.137029] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.137171] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.137363] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.139823] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7dea745-a175-4b35-be11-632b67360954 with status ACTIVE [ 740.140025] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.140181] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.140228] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.141322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.141322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.141322] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.141322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.141322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.141322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.141322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.141322] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.141322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.141700] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.141700] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.141700] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.141700] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7dea745-a175-4b35-be11-632b67360954 is going to be updated. [ 740.178037] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.178190] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.178223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.178425] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.178555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.178761] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7dea745-a175-4b35-be11-632b67360954" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.241600] env[71140]: INFO networking_nsxv3.common.synchronization [None req-532e2a6d-e131-428b-8407-7a65d7ddd86c None None] Enqueued Resource ID: ecbfe420-14fe-4849-8f15-a4dee616df8f with Priority: HIGHEST for action port [ 740.242421] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecbfe420-14fe-4849-8f15-a4dee616df8f with Priority: HIGHEST for action port [ 740.242565] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecbfe420-14fe-4849-8f15-a4dee616df8f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.242671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecbfe420-14fe-4849-8f15-a4dee616df8f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.246020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecbfe420-14fe-4849-8f15-a4dee616df8f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.246020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecbfe420-14fe-4849-8f15-a4dee616df8f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.246020] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecbfe420-14fe-4849-8f15-a4dee616df8f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.441493] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.441847] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.441847] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.442029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.442129] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.442279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.442342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.442463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.442555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.442654] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.442790] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.442888] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.442950] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.443116] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.443252] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.443344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.443406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.443549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.443623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.443705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.443795] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.639167] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.746596] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecbfe420-14fe-4849-8f15-a4dee616df8f [ 740.746852] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.746986] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.747069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.747284] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.747383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.747513] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecbfe420-14fe-4849-8f15-a4dee616df8f already deleted. [ 740.747580] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecbfe420-14fe-4849-8f15-a4dee616df8f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.946531] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597: rpc.has_security_group_logging(os_id): False [ 740.965280] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.965435] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.965501] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.965722] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.965827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.966036] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.966139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.966202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.966361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.966461] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.966670] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.966767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.966830] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.966982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.967071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.967723] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.967723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.967723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.967723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.967723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.967723] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 is going to be updated. [ 741.050238] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.050238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.050238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.050238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.050495] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.078733] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: IN_PROGRESS for 2s [ 741.143560] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.143728] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.143799] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.144043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.144143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.144242] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 is going to be created. [ 741.175354] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.175684] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.176160] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.179018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.180609] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.191020] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: UNINITIALIZED for 2s [ 741.348539] env[71140]: INFO networking_nsxv3.common.synchronization [None req-61fc4129-f9e4-4cf5-aab9-7cc44954b117 tempest-AttachVolumeNegativeTest-950002537 tempest-AttachVolumeNegativeTest-950002537-project-member] Enqueued Resource ID: 6f6ea965-586b-4847-a20f-3619378cb260 with Priority: HIGHEST for action security_group_rules [ 741.349145] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6ea965-586b-4847-a20f-3619378cb260 with Priority: HIGHEST for action security_group_rules [ 741.349445] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f6ea965-586b-4847-a20f-3619378cb260 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.349618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.349673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.349922] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.350077] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f6ea965-586b-4847-a20f-3619378cb260',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.475949] env[71140]: INFO networking_nsxv3.common.synchronization [None req-8a03ed7d-4dde-4e0a-9366-9a821129a2ef tempest-AttachVolumeNegativeTest-950002537 tempest-AttachVolumeNegativeTest-950002537-project-member] Enqueued Resource ID: 6f6ea965-586b-4847-a20f-3619378cb260 with Priority: HIGHEST for action security_group_rules [ 741.476625] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6ea965-586b-4847-a20f-3619378cb260 with Priority: HIGHEST for action security_group_rules [ 741.477051] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f6ea965-586b-4847-a20f-3619378cb260 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.477139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.838119] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 741.838312] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 deletion is rescheduled due to dependency. [ 741.838427] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.870531] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.870531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.870531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.870531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.870800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.870800] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f6ea965-586b-4847-a20f-3619378cb260 already deleted. [ 741.870860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.871033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.871206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.871305] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f6ea965-586b-4847-a20f-3619378cb260',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.395805] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.396337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.396589] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.396838] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.396935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.397055] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f6ea965-586b-4847-a20f-3619378cb260 already deleted. [ 742.397718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.669624] env[71140]: INFO networking_nsxv3.common.synchronization [None req-9f92a36c-1bb6-4fc4-96e8-98fdcaf16379 None None] Enqueued Resource ID: 0255acca-42cd-4327-b742-8bea546aed2a with Priority: HIGHEST for action port [ 742.669624] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0255acca-42cd-4327-b742-8bea546aed2a with Priority: HIGHEST for action port [ 742.669624] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-0255acca-42cd-4327-b742-8bea546aed2a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.669624] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0255acca-42cd-4327-b742-8bea546aed2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.669624] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0255acca-42cd-4327-b742-8bea546aed2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.671961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0255acca-42cd-4327-b742-8bea546aed2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.671961] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0255acca-42cd-4327-b742-8bea546aed2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.791405] env[71140]: INFO networking_nsxv3.common.synchronization [req-07534686-843c-47a0-99d1-0f2a9c301ab1 req-73626591-479d-4306-9098-20eda8f903a5 tempest-ListServersNegativeTestJSON-2012900449 tempest-ListServersNegativeTestJSON-2012900449-project-member] Enqueued Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 742.791405] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 742.791405] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.791405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.094245] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: SUCCESS [ 743.094245] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.094245] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.094245] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.094245] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.174520] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.175013] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-428" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.175153] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-428" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.175438] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-428" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.175851] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.176040] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.176176] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.176449] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.176630] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.176785] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.176912] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.177079] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.177142] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.177293] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.177429] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.177532] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.179363] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0255acca-42cd-4327-b742-8bea546aed2a [ 743.182739] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.182739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.182739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.182739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.182739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.182739] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0255acca-42cd-4327-b742-8bea546aed2a already deleted. [ 743.182739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0255acca-42cd-4327-b742-8bea546aed2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.202693] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: SUCCESS [ 743.202902] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.203122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.203358] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.203558] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.203693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.203744] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.203896] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.203979] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.204078] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.204180] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.205092] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.205263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.205419] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.205532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.205596] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.205779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.205827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.205881] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.210061] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.210061] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 743.210061] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.210061] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-428" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.210061] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-3557312b-9d99-450e-b27c-81e203189555 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.210061] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-3557312b-9d99-450e-b27c-81e203189555" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.210061] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-3557312b-9d99-450e-b27c-81e203189555" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.210061] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-3557312b-9d99-450e-b27c-81e203189555" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.210446] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3557312b-9d99-450e-b27c-81e203189555',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.596085] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.596266] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.596339] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.596719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.596913] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.597044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.597115] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.597298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.597392] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.597567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.597675] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.708270] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.708590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.712028] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.712207] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.712332] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.712608] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.712759] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.712914] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 3557312b-9d99-450e-b27c-81e203189555 not found, creating... [ 743.713183] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.713338] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.713454] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.713678] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.713818] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.714111] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.714267] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.714404] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.714619] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.714757] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.714896] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 3557312b-9d99-450e-b27c-81e203189555 is going to be created. [ 743.715946] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.734220] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.734433] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.734561] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.735309] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.735309] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.735309] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-3557312b-9d99-450e-b27c-81e203189555" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.100253] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.100471] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.100582] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.100859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.100999] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.101137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.101183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.101338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.101445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.101546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.101781] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.101826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.101892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.102779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.102779] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.102779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.102779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.102779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.102779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.102779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.102779] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.218585] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.605893] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597: rpc.has_security_group_logging(os_id): False [ 744.626774] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.626774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.626774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.626774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.626774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.626774] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.626774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.626774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.626774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.626774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.626774] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.626774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.626774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.627270] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.627270] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.627270] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.627270] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.627664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.627925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.628111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.628282] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 is going to be updated. [ 744.653232] env[71140]: INFO networking_nsxv3.common.synchronization [req-07534686-843c-47a0-99d1-0f2a9c301ab1 req-3d8ce65f-5017-4935-a25d-44fe39ad3f9a service nova] Enqueued Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_rules [ 744.653232] env[71140]: INFO networking_nsxv3.common.synchronization [req-07534686-843c-47a0-99d1-0f2a9c301ab1 req-3d8ce65f-5017-4935-a25d-44fe39ad3f9a service nova] Enqueued Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 744.653232] env[71140]: INFO networking_nsxv3.common.synchronization [req-07534686-843c-47a0-99d1-0f2a9c301ab1 req-3d8ce65f-5017-4935-a25d-44fe39ad3f9a service nova] Enqueued Resource ID: 3557312b-9d99-450e-b27c-81e203189555 with Priority: HIGHEST for action port [ 744.653232] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_rules [ 744.653232] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 744.653232] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3557312b-9d99-450e-b27c-81e203189555 with Priority: HIGHEST for action port [ 744.654260] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.654662] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.654961] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.655183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.655562] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-3557312b-9d99-450e-b27c-81e203189555 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.655779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3557312b-9d99-450e-b27c-81e203189555" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.655938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3557312b-9d99-450e-b27c-81e203189555" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.656224] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3557312b-9d99-450e-b27c-81e203189555" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.656390] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3557312b-9d99-450e-b27c-81e203189555',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.695536] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.695674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.695674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.695891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.696805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.709498] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: IN_PROGRESS for 2s [ 744.720104] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.720264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.720336] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.720547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.720642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.720740] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 is going to be updated. [ 744.792271] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.792430] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.792512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.792704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.792843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.816094] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: IN_PROGRESS for 2s [ 745.159831] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3557312b-9d99-450e-b27c-81e203189555 with status ACTIVE [ 745.160096] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.160404] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.160404] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.161031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.161031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.161031] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.161031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.161031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.161266] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.161266] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.161369] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.161465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.161534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.162150] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.162304] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.162400] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3557312b-9d99-450e-b27c-81e203189555 is going to be updated. [ 745.198285] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.198438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.198684] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.198813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.199636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.199636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3557312b-9d99-450e-b27c-81e203189555" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.445133] env[71140]: INFO networking_nsxv3.common.synchronization [req-07534686-843c-47a0-99d1-0f2a9c301ab1 req-48c522e8-dc44-4665-b001-0451404d23d7 tempest-ListServersNegativeTestJSON-2012900449 tempest-ListServersNegativeTestJSON-2012900449-project-member] Enqueued Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 745.446856] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 745.446856] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.446856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.845360] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.845694] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-428" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.845854] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-428" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.846506] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-428" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.846946] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.847250] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.847444] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.847891] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.848160] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.848504] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.848719] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.849016] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.849235] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.849435] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.849645] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.849887] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.871441] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.871596] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 745.871735] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.871913] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-428" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.872885] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-64f80b62-390f-4083-a22d-c74f253cc062 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.872885] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-64f80b62-390f-4083-a22d-c74f253cc062" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.872885] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-64f80b62-390f-4083-a22d-c74f253cc062" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.872885] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-64f80b62-390f-4083-a22d-c74f253cc062" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.873264] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64f80b62-390f-4083-a22d-c74f253cc062',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.375334] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.375519] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.375599] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.375834] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.376052] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.376203] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 64f80b62-390f-4083-a22d-c74f253cc062 not found, creating... [ 746.376577] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.376760] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.376881] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.377176] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.377363] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.377707] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.377962] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.378073] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.378328] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.378495] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.378663] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 64f80b62-390f-4083-a22d-c74f253cc062 is going to be created. [ 746.397953] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.398237] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.398384] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.398918] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.399280] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.399621] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-64f80b62-390f-4083-a22d-c74f253cc062" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.726051] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: SUCCESS [ 746.726280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.826498] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: SUCCESS [ 746.826992] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.827048] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.827263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.827468] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.827668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.827730] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.827934] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.828038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.828130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.828306] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.828392] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.828455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.828603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.828748] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.828842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.828904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.829052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.829128] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.829206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.829300] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.830116] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.830280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.830428] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.830582] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.831891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.831891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.831891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.831891] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.183441] env[71140]: INFO networking_nsxv3.common.synchronization [req-07534686-843c-47a0-99d1-0f2a9c301ab1 req-d684854c-0e18-4263-b25f-043cae62a407 service nova] Enqueued Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_rules [ 747.183714] env[71140]: INFO networking_nsxv3.common.synchronization [req-07534686-843c-47a0-99d1-0f2a9c301ab1 req-d684854c-0e18-4263-b25f-043cae62a407 service nova] Enqueued Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 747.183793] env[71140]: INFO networking_nsxv3.common.synchronization [req-07534686-843c-47a0-99d1-0f2a9c301ab1 req-d684854c-0e18-4263-b25f-043cae62a407 service nova] Enqueued Resource ID: 64f80b62-390f-4083-a22d-c74f253cc062 with Priority: HIGHEST for action port [ 747.184040] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_rules [ 747.184174] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 747.184269] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f80b62-390f-4083-a22d-c74f253cc062 with Priority: HIGHEST for action port [ 747.184918] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.184971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.185758] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.185917] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.186158] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-64f80b62-390f-4083-a22d-c74f253cc062 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.186279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64f80b62-390f-4083-a22d-c74f253cc062" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.186344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64f80b62-390f-4083-a22d-c74f253cc062" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.190022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64f80b62-390f-4083-a22d-c74f253cc062" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.190022] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64f80b62-390f-4083-a22d-c74f253cc062',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.333680] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e12e6f08-d99f-4fd3-9323-d04895bd2256: rpc.has_security_group_logging(os_id): False [ 747.334258] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.353124] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.353564] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.353564] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.353564] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.353674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.353844] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.354094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.354094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.354184] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.354227] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.354582] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.354582] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.354690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.354821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.355076] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.355211] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.355330] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.355448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.355529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.356051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.356051] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 is going to be created. [ 747.410306] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.410467] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.410551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.410801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.410988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.421388] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: IN_PROGRESS for 2s [ 747.691500] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64f80b62-390f-4083-a22d-c74f253cc062 with status ACTIVE [ 747.691749] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.691890] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.691963] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.692218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.692312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.692494] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.692600] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.692661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.692812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.692889] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.693082] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.693177] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.693236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.693377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.693450] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.693537] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64f80b62-390f-4083-a22d-c74f253cc062 is going to be updated. [ 747.713958] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.714127] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.714229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.714439] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.714602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.714769] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64f80b62-390f-4083-a22d-c74f253cc062" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.837389] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.339969] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.340303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.340303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.340446] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.340542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.340653] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 is going to be updated. [ 748.368947] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.368947] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.368947] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.368947] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.368947] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.376540] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: IN_PROGRESS for 2s [ 749.438379] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: SUCCESS [ 749.438379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.438379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.438379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.438379] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.941273] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.941412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.157062] env[71140]: INFO networking_nsxv3.common.synchronization [req-f895af0a-c93e-4dc9-a190-091865675fe0 req-04504339-0c51-47c2-8024-41cbe4c9bff5 tempest-AttachVolumeShelveTestJSON-926657130 tempest-AttachVolumeShelveTestJSON-926657130-project-member] Enqueued Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGHEST for action security_group_members [ 750.157779] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGHEST for action security_group_members [ 750.158198] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.158402] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.158494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.159558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.159780] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.159891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.159958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.160160] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.160215] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.160317] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.387730] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: SUCCESS [ 750.387981] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.388426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.388670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.388902] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.389061] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.389135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.389485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.389600] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.389737] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.625030] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.625030] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-600" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.625030] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-600" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.625030] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-600" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.625030] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.625030] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.625030] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.626080] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.626611] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.626839] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 750.627067] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 750.627967] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 750.627967] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 750.627967] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 750.627967] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 750.627967] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 750.649346] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 750.649346] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 750.649346] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 750.649346] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-600" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.649346] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-79048504-5fc2-4884-9daf-c99163754397 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.649346] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-79048504-5fc2-4884-9daf-c99163754397" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.649346] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-79048504-5fc2-4884-9daf-c99163754397" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.649346] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-79048504-5fc2-4884-9daf-c99163754397" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.649346] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79048504-5fc2-4884-9daf-c99163754397',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.666493] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.666493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.666493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.666493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.666493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.666493] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.666493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.666493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.666493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.666493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.666493] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 already deleted. [ 750.666493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.899548] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.092967] env[71140]: INFO networking_nsxv3.common.synchronization [None req-50e5e0d5-8db4-4cfe-8411-90098ba4ca1f None None] Enqueued Resource ID: a67c979f-9204-4e40-a192-d28f9269d08c with Priority: HIGHEST for action port [ 751.093392] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a67c979f-9204-4e40-a192-d28f9269d08c with Priority: HIGHEST for action port [ 751.094188] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-a67c979f-9204-4e40-a192-d28f9269d08c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.094390] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a67c979f-9204-4e40-a192-d28f9269d08c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.094498] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a67c979f-9204-4e40-a192-d28f9269d08c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.094789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a67c979f-9204-4e40-a192-d28f9269d08c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.094907] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a67c979f-9204-4e40-a192-d28f9269d08c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.157421] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.157421] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.157421] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.157421] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.157421] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.157421] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 79048504-5fc2-4884-9daf-c99163754397 not found, creating... [ 751.157421] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.157421] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.157421] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.157421] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.158035] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.158035] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.158035] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.161489] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.161657] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.161819] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.162014] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 79048504-5fc2-4884-9daf-c99163754397 is going to be created. [ 751.185523] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.185727] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.185857] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.186151] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.186388] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.186664] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-79048504-5fc2-4884-9daf-c99163754397" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.403431] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.600209] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a67c979f-9204-4e40-a192-d28f9269d08c [ 751.600904] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.600904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.600904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.600904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.601094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.601228] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a67c979f-9204-4e40-a192-d28f9269d08c already deleted. [ 751.603205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a67c979f-9204-4e40-a192-d28f9269d08c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.906159] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.906487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.906487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.906670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.906766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.906870] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 is going to be updated. [ 751.942183] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.942183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.942183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.942183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.942183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.950209] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: IN_PROGRESS for 2s [ 751.960941] env[71140]: INFO networking_nsxv3.common.synchronization [req-f895af0a-c93e-4dc9-a190-091865675fe0 req-332d9c22-9408-46fb-b5bc-4ecd063630d0 service nova] Enqueued Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGHEST for action security_group_rules [ 751.961120] env[71140]: INFO networking_nsxv3.common.synchronization [req-f895af0a-c93e-4dc9-a190-091865675fe0 req-332d9c22-9408-46fb-b5bc-4ecd063630d0 service nova] Enqueued Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGHEST for action security_group_members [ 751.962018] env[71140]: INFO networking_nsxv3.common.synchronization [req-f895af0a-c93e-4dc9-a190-091865675fe0 req-332d9c22-9408-46fb-b5bc-4ecd063630d0 service nova] Enqueued Resource ID: 79048504-5fc2-4884-9daf-c99163754397 with Priority: HIGHEST for action port [ 751.962018] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGHEST for action security_group_rules [ 751.962018] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGHEST for action security_group_members [ 751.962018] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79048504-5fc2-4884-9daf-c99163754397 with Priority: HIGHEST for action port [ 751.962472] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.962472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.962590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.964561] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.964652] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.967721] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.967721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.967721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.967721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.967721] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.967721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.967721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.967721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.967721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.967721] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.968255] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-79048504-5fc2-4884-9daf-c99163754397 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.968255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79048504-5fc2-4884-9daf-c99163754397" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.968255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79048504-5fc2-4884-9daf-c99163754397" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.968255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79048504-5fc2-4884-9daf-c99163754397" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.968255] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79048504-5fc2-4884-9daf-c99163754397',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.472242] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.472242] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.472961] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.474654] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79048504-5fc2-4884-9daf-c99163754397 with status ACTIVE [ 752.475079] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.475171] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.475208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.476015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.476015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.476015] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.476015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.476015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.476207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.476438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.480439] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.480439] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.480439] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.480614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.480694] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.480781] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79048504-5fc2-4884-9daf-c99163754397 is going to be updated. [ 752.503638] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.503638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.503638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.503638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.503638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.503638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79048504-5fc2-4884-9daf-c99163754397" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.983417] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.229210] env[71140]: INFO networking_nsxv3.common.synchronization [req-2aa41598-e173-490b-89df-7277d6e07187 req-990fdcf2-b5e9-4430-b358-164ff086b5fe tempest-InstanceActionsTestJSON-934591016 tempest-InstanceActionsTestJSON-934591016-project-member] Enqueued Resource ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 with Priority: HIGHEST for action security_group_members [ 753.229782] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 with Priority: HIGHEST for action security_group_members [ 753.230148] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a4b8219-796d-434e-a45e-ef4800a05c31 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.230282] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.230350] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.230596] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.230756] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.230851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.230932] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.236239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.236239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.236239] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a4b8219-796d-434e-a45e-ef4800a05c31',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.487354] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.487568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.487647] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.487871] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.487968] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.488079] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 is going to be created. [ 753.515016] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.515016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.515016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.515016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.515016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.532690] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 in Status: UNINITIALIZED for 2s [ 753.574182] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-295 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.574182] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-295" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.574182] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-295" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.574182] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-295" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.575019] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.575019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.575019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.575019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.575425] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.575681] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.575846] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.576173] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.576173] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.576313] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.576469] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.576669] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.593887] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.594234] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 753.594387] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.594561] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-295" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.594848] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-38148fda-881d-48e8-a92e-1b87b7f95649 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.595025] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-38148fda-881d-48e8-a92e-1b87b7f95649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.595146] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-38148fda-881d-48e8-a92e-1b87b7f95649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.595450] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-38148fda-881d-48e8-a92e-1b87b7f95649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.595598] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38148fda-881d-48e8-a92e-1b87b7f95649',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.739213] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.739721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.739897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.740239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.740404] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.740751] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.741157] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.741346] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.741574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.741687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.741806] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 already deleted. [ 753.741919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.889717] env[71140]: INFO networking_nsxv3.common.synchronization [None req-d626d1e2-61e5-4d7a-92f0-af30d4556ee0 None None] Enqueued Resource ID: bbdf60e6-1ad8-40a8-80e3-2b8d8a71206f with Priority: HIGHEST for action port [ 753.890388] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbdf60e6-1ad8-40a8-80e3-2b8d8a71206f with Priority: HIGHEST for action port [ 753.890896] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbdf60e6-1ad8-40a8-80e3-2b8d8a71206f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.891172] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbdf60e6-1ad8-40a8-80e3-2b8d8a71206f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.891286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbdf60e6-1ad8-40a8-80e3-2b8d8a71206f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.891621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbdf60e6-1ad8-40a8-80e3-2b8d8a71206f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.891756] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbdf60e6-1ad8-40a8-80e3-2b8d8a71206f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.960288] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: SUCCESS [ 753.960592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.960771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.961011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.961216] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.961346] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.961428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.961601] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.961682] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.961836] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.101757] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.101757] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.101757] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.102232] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.102317] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.102533] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 38148fda-881d-48e8-a92e-1b87b7f95649 not found, creating... [ 754.102917] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.103133] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.103262] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.103496] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.103627] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.103906] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.104071] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.104186] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.104399] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.104526] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.104663] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 38148fda-881d-48e8-a92e-1b87b7f95649 is going to be created. [ 754.125035] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.125720] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.125720] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.125720] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.125994] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.126289] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-38148fda-881d-48e8-a92e-1b87b7f95649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.394730] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bbdf60e6-1ad8-40a8-80e3-2b8d8a71206f [ 754.395523] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.395708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.395804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.396045] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.396144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.396242] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bbdf60e6-1ad8-40a8-80e3-2b8d8a71206f already deleted. [ 754.396321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbdf60e6-1ad8-40a8-80e3-2b8d8a71206f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.464421] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.895378] env[71140]: INFO networking_nsxv3.common.synchronization [req-2aa41598-e173-490b-89df-7277d6e07187 req-0290ca5c-97b6-4c42-8025-656ce669fc79 service nova] Enqueued Resource ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 with Priority: HIGHEST for action security_group_rules [ 754.895606] env[71140]: INFO networking_nsxv3.common.synchronization [req-2aa41598-e173-490b-89df-7277d6e07187 req-0290ca5c-97b6-4c42-8025-656ce669fc79 service nova] Enqueued Resource ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 with Priority: HIGHEST for action security_group_members [ 754.895749] env[71140]: INFO networking_nsxv3.common.synchronization [req-2aa41598-e173-490b-89df-7277d6e07187 req-0290ca5c-97b6-4c42-8025-656ce669fc79 service nova] Enqueued Resource ID: 38148fda-881d-48e8-a92e-1b87b7f95649 with Priority: HIGHEST for action port [ 754.901919] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 with Priority: HIGHEST for action security_group_rules [ 754.901919] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 with Priority: HIGHEST for action security_group_members [ 754.901919] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38148fda-881d-48e8-a92e-1b87b7f95649 with Priority: HIGHEST for action port [ 754.901919] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a4b8219-796d-434e-a45e-ef4800a05c31 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.901919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.901919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.901919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.901919] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a4b8219-796d-434e-a45e-ef4800a05c31',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.905699] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a4b8219-796d-434e-a45e-ef4800a05c31 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.905826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.905944] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.906202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.906373] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.906492] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.906571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.906731] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.906815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.906909] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a4b8219-796d-434e-a45e-ef4800a05c31',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.908044] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-38148fda-881d-48e8-a92e-1b87b7f95649 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.908154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38148fda-881d-48e8-a92e-1b87b7f95649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.908219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38148fda-881d-48e8-a92e-1b87b7f95649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.908523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38148fda-881d-48e8-a92e-1b87b7f95649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.908604] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38148fda-881d-48e8-a92e-1b87b7f95649',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.967699] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.414425] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38148fda-881d-48e8-a92e-1b87b7f95649 with status ACTIVE [ 755.414707] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.414707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.414707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.414966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.415128] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.415395] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.415536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.415659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.415985] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.416088] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.416404] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.416580] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.416712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.416955] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.417951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.417951] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38148fda-881d-48e8-a92e-1b87b7f95649 is going to be updated. [ 755.419278] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a4b8219-796d-434e-a45e-ef4800a05c31',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.420226] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a4b8219-796d-434e-a45e-ef4800a05c31 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.420345] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.440291] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.440291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.440291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.440291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.440291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.440291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38148fda-881d-48e8-a92e-1b87b7f95649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.470719] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.470858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.470895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.471374] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.471374] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.471374] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 is going to be updated. [ 755.519158] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.519952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.519952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.519952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.519952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.528824] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: IN_PROGRESS for 2s [ 755.537434] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 in Status: SUCCESS [ 755.537669] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.538252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.540324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.540464] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.540612] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.540648] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.540809] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.540900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.540995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.541137] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.923782] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a4b8219-796d-434e-a45e-ef4800a05c31',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.028302] env[71140]: INFO networking_nsxv3.common.synchronization [req-ba7f5656-4ed6-4f9a-9c34-dc385a933f73 req-3115228d-c597-4baa-a400-2be200da5dab tempest-ListServerFiltersTestJSON-1641915528 tempest-ListServerFiltersTestJSON-1641915528-project-member] Enqueued Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 756.028302] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 756.028302] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.028302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.028302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.028302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.029012] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.031371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.031371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.031371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.031371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.031371] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.046175] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.427835] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.427835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.427835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.428328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.428328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.428328] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 is going to be created. [ 756.450979] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.451159] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.451230] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.451442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.451599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.464570] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 in Status: UNINITIALIZED for 2s [ 756.532901] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.546521] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94b91392-e2c9-4bb1-8e2f-6bc3569d8721: rpc.has_security_group_logging(os_id): False [ 756.563537] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.563688] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.563757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.563962] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.564068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.564305] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.564407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.564486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.564799] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.564799] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.564799] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 is going to be created. [ 756.618407] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.618662] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.618756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.618975] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.619173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.631474] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 in Status: IN_PROGRESS for 2s [ 757.037922] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.539058] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: SUCCESS [ 757.539348] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.539575] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.539694] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.539765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.539982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.540084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.540177] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 is going to be updated. [ 757.541434] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.541868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.541868] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.542015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.542097] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.542287] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.542413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.542523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.542631] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.567059] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.567292] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.567419] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.567746] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.567928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.575757] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: IN_PROGRESS for 2s [ 758.010637] env[71140]: INFO networking_nsxv3.common.synchronization [req-c64d1ce4-c7ba-4e8f-9927-ae5c54d033e4 req-2f2b0bb2-45d9-4ee8-8045-6174bf3ce4b8 tempest-ListServersNegativeTestJSON-2012900449 tempest-ListServersNegativeTestJSON-2012900449-project-member] Enqueued Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 758.010637] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 758.010637] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.010637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.010637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.010637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.010637] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.010637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.010637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.010637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.010637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.010637] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.045645] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.045847] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.472663] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 in Status: SUCCESS [ 758.472883] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.473063] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.473305] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.473499] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.473615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.473668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.473834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.473920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.474010] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.474105] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a4b8219-796d-434e-a45e-ef4800a05c31',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.513123] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.542927] env[71140]: INFO networking_nsxv3.common.synchronization [req-9a1e6658-3455-40a4-8771-0df7a80a27a2 req-86ded7e3-005c-4d3d-a0a5-3e43297520e0 tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 with Priority: HIGHEST for action security_group_members [ 758.543523] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 with Priority: HIGHEST for action security_group_members [ 758.544042] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcc20535-4cb4-4221-b041-8dd02e4b3787 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.544042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.544141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.544383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.544561] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.544685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.544755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.544965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.545069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.545166] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcc20535-4cb4-4221-b041-8dd02e4b3787',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.645122] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 in Status: SUCCESS [ 758.645380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.851638] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-941 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.851758] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.851793] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.852151] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.852429] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.852587] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.852705] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.852935] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.853231] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.853500] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 758.853652] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.853791] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.853929] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.854110] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 758.854249] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.854413] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.878220] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.878382] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 758.878515] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.878695] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.878999] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-55bc1389-9a59-4831-bdef-08e260a26ee6 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.879183] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-55bc1389-9a59-4831-bdef-08e260a26ee6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.879303] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-55bc1389-9a59-4831-bdef-08e260a26ee6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.879684] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-55bc1389-9a59-4831-bdef-08e260a26ee6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.879896] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55bc1389-9a59-4831-bdef-08e260a26ee6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.976350] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a4b8219-796d-434e-a45e-ef4800a05c31 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.976528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.976599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.976798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.976959] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.977070] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.977133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.977277] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.977364] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.977447] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.977593] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a4b8219-796d-434e-a45e-ef4800a05c31 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.977705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.977765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.977905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.978103] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.978209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.978266] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.978404] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.978477] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.978556] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.978643] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a4b8219-796d-434e-a45e-ef4800a05c31',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.018164] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.047627] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.048595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.048595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.048595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.048595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.049072] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.049072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.049072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.049226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.049722] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.049722] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 already deleted. [ 759.049722] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.381649] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.381871] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.382030] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.382341] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.382805] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.382805] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 55bc1389-9a59-4831-bdef-08e260a26ee6 not found, creating... [ 759.382934] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.383105] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.383243] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.383491] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.383615] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.383911] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.384081] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.384196] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.384400] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.384538] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.385092] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 55bc1389-9a59-4831-bdef-08e260a26ee6 is going to be created. [ 759.403390] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.403842] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.403842] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.404642] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.404642] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.404642] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-55bc1389-9a59-4831-bdef-08e260a26ee6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.481620] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a4b8219-796d-434e-a45e-ef4800a05c31: rpc.has_security_group_logging(os_id): False [ 759.506295] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.506425] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.506565] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.506807] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.506928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.507184] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.508055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.508055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.508055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.508055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.508055] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.508055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.508055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.508391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.508391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.508536] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.508656] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.508733] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.508886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.509118] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.509118] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 is going to be created. [ 759.519978] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.521060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.521060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.521060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.521060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.521060] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 is going to be updated. [ 759.568202] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.568202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.568572] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.568572] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.568638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.577270] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: IN_PROGRESS for 2s [ 759.584859] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.584991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.585078] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.585331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.585481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.588126] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: SUCCESS [ 759.588758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.599585] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 in Status: IN_PROGRESS for 2s [ 760.119927] env[71140]: INFO networking_nsxv3.common.synchronization [req-9a1e6658-3455-40a4-8771-0df7a80a27a2 req-355710dc-bb8a-499f-b4ae-b9e6c142f030 service nova] Enqueued Resource ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 with Priority: HIGHEST for action security_group_rules [ 760.120275] env[71140]: INFO networking_nsxv3.common.synchronization [req-9a1e6658-3455-40a4-8771-0df7a80a27a2 req-355710dc-bb8a-499f-b4ae-b9e6c142f030 service nova] Enqueued Resource ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 with Priority: HIGHEST for action security_group_members [ 760.120613] env[71140]: INFO networking_nsxv3.common.synchronization [req-9a1e6658-3455-40a4-8771-0df7a80a27a2 req-355710dc-bb8a-499f-b4ae-b9e6c142f030 service nova] Enqueued Resource ID: 55bc1389-9a59-4831-bdef-08e260a26ee6 with Priority: HIGHEST for action port [ 760.121382] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 with Priority: HIGHEST for action security_group_rules [ 760.121523] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 with Priority: HIGHEST for action security_group_members [ 760.121645] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55bc1389-9a59-4831-bdef-08e260a26ee6 with Priority: HIGHEST for action port [ 760.122125] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcc20535-4cb4-4221-b041-8dd02e4b3787 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.122125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.123290] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.123290] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.123290] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcc20535-4cb4-4221-b041-8dd02e4b3787',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.125241] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcc20535-4cb4-4221-b041-8dd02e4b3787 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.125363] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.125433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.125607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.125759] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.126101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.126181] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.126323] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.126440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.126538] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcc20535-4cb4-4221-b041-8dd02e4b3787',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.127948] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-55bc1389-9a59-4831-bdef-08e260a26ee6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.127948] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55bc1389-9a59-4831-bdef-08e260a26ee6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.127948] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55bc1389-9a59-4831-bdef-08e260a26ee6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.128139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55bc1389-9a59-4831-bdef-08e260a26ee6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.128184] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55bc1389-9a59-4831-bdef-08e260a26ee6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.629938] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcc20535-4cb4-4221-b041-8dd02e4b3787 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.630490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.630490] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fcc20535-4cb4-4221-b041-8dd02e4b3787',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.631240] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55bc1389-9a59-4831-bdef-08e260a26ee6 with status ACTIVE [ 760.632621] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.632621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.632621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.632621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.632621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.632621] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.632621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.632621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.633198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.633288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.633543] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.633778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.633778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.637301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.637301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.637301] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55bc1389-9a59-4831-bdef-08e260a26ee6 is going to be updated. [ 760.655760] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.655760] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.656026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.657110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.657338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.657520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55bc1389-9a59-4831-bdef-08e260a26ee6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.137970] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fcc20535-4cb4-4221-b041-8dd02e4b3787',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.587083] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: SUCCESS [ 761.587301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.587461] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.587709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.587919] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.588071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.588136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.588294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.588370] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.588449] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.588654] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.588724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.590237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.590237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.590237] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.590237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.590237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.590237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.590237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.590237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.590237] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.614861] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 in Status: SUCCESS [ 761.615187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.639736] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.640144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.640144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.640261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.640326] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.640382] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 is going to be created. [ 761.663216] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.663368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.663441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.663667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.663825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.672285] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 in Status: UNINITIALIZED for 2s [ 762.092232] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e12e6f08-d99f-4fd3-9323-d04895bd2256: rpc.has_security_group_logging(os_id): False [ 762.109347] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.109544] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.109899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.109899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.109899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.110142] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.110267] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.110332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.110509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.110589] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.110841] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.110945] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.110945] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.111592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.111592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.111592] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.111592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.111592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.111857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.111857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.111922] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 is going to be updated. [ 762.181677] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.181820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.181899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.182129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.182275] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.199101] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: IN_PROGRESS for 2s [ 762.375090] env[71140]: INFO networking_nsxv3.common.synchronization [req-3004fb1d-2954-4fff-beba-150388fb8330 req-486fd402-a7b0-4fc9-8c2d-66b99bf5d60c tempest-ServersAdminNegativeTestJSON-368123288 tempest-ServersAdminNegativeTestJSON-368123288-project-member] Enqueued Resource ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 with Priority: HIGHEST for action security_group_members [ 762.375721] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 with Priority: HIGHEST for action security_group_members [ 762.378118] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-522bdeb8-3be1-4507-b2cc-adc33ff88371 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.378975] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.378975] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.378975] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.378975] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.379254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.379300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.380029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.380029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.380029] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('522bdeb8-3be1-4507-b2cc-adc33ff88371',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.882592] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.882905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.882905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.883040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.883089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.883289] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.883384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.883441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.883593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.883672] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.883757] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 is going to be updated. [ 762.910305] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.910305] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.910305] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.910482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.910482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.919291] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 in Status: IN_PROGRESS for 2s [ 763.227242] env[71140]: INFO networking_nsxv3.common.synchronization [req-c30ea7b9-c78d-4eb0-ab6a-59cee1b0495c req-7c21b6f0-5f62-4242-9d00-81bdd24e1a26 tempest-DeleteServersTestJSON-1199867382 tempest-DeleteServersTestJSON-1199867382-project-member] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 763.227876] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 763.228215] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.228372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.228452] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.228797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.228911] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.228990] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.229064] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.229220] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.229307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.229412] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.572020] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-351 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.572020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.572020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.572020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.572020] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.572368] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.572368] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.572547] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.572691] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.572890] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 763.574037] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.574037] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.574037] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.574037] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 763.574037] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.574037] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.590701] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.590944] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 763.591031] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.591216] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.591513] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-94424b02-85b8-4af0-a823-eda23fbba25f taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.591722] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-94424b02-85b8-4af0-a823-eda23fbba25f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.591815] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-94424b02-85b8-4af0-a823-eda23fbba25f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.592204] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-94424b02-85b8-4af0-a823-eda23fbba25f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.592373] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94424b02-85b8-4af0-a823-eda23fbba25f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.685047] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 in Status: SUCCESS [ 763.685908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.685908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.685908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.685908] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.686278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.686278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.686278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.686387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.686594] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.686594] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fcc20535-4cb4-4221-b041-8dd02e4b3787',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.731224] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.731390] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.731433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.731640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.731731] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.731923] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.732028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.732145] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.732241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.732341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.732455] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 already deleted. [ 763.732549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.094411] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.094954] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.094954] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.095142] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.095206] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.100026] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 94424b02-85b8-4af0-a823-eda23fbba25f not found, creating... [ 764.100026] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.100026] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.100026] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.100026] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.100026] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.100026] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.100026] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.100026] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.100682] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.100682] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.100682] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 94424b02-85b8-4af0-a823-eda23fbba25f is going to be created. [ 764.116911] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.117121] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.117241] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.117500] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.117723] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.118021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-94424b02-85b8-4af0-a823-eda23fbba25f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.189935] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fcc20535-4cb4-4221-b041-8dd02e4b3787',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.212922] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: SUCCESS [ 764.213145] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.213331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.213546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.213632] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.693441] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fcc20535-4cb4-4221-b041-8dd02e4b3787: rpc.has_security_group_logging(os_id): False [ 764.716154] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.716154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.716154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.716154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.716154] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.716154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.716154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.716154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.716154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.716623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.716623] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.719663] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.719663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.719663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.719812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.719844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.720855] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.720855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.720855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.720855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.720855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.720855] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 is going to be created. [ 764.790615] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.790615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.790615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.790817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.791025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.801160] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 in Status: IN_PROGRESS for 2s [ 764.933612] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 in Status: SUCCESS [ 764.933809] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 522bdeb8-3be1-4507-b2cc-adc33ff88371 deletion is rescheduled due to dependency. [ 764.933923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-522bdeb8-3be1-4507-b2cc-adc33ff88371" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.947696] env[71140]: INFO networking_nsxv3.common.synchronization [req-c30ea7b9-c78d-4eb0-ab6a-59cee1b0495c req-b0171984-4ba5-441a-b270-fe746ae71351 service nova] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_rules [ 764.950255] env[71140]: INFO networking_nsxv3.common.synchronization [req-c30ea7b9-c78d-4eb0-ab6a-59cee1b0495c req-b0171984-4ba5-441a-b270-fe746ae71351 service nova] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 764.950255] env[71140]: INFO networking_nsxv3.common.synchronization [req-c30ea7b9-c78d-4eb0-ab6a-59cee1b0495c req-b0171984-4ba5-441a-b270-fe746ae71351 service nova] Enqueued Resource ID: 94424b02-85b8-4af0-a823-eda23fbba25f with Priority: HIGHEST for action port [ 764.950255] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_rules [ 764.950255] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 764.950255] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94424b02-85b8-4af0-a823-eda23fbba25f with Priority: HIGHEST for action port [ 764.950255] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.951238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.951238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.951238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.951238] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.952177] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.952177] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.952177] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.952371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.952751] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.952751] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.952751] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.952898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.953814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.953814] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.954101] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-94424b02-85b8-4af0-a823-eda23fbba25f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.954205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94424b02-85b8-4af0-a823-eda23fbba25f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.954267] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94424b02-85b8-4af0-a823-eda23fbba25f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.954652] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94424b02-85b8-4af0-a823-eda23fbba25f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.954652] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94424b02-85b8-4af0-a823-eda23fbba25f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.219350] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.219712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.219712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.219787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.219947] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.220057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.220109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.220238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.220326] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.220412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.221311] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.221568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.221641] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.221817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.221973] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.222093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.222146] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.222300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.222381] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.222463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.222553] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.455718] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.457428] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.457428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.461759] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94424b02-85b8-4af0-a823-eda23fbba25f with status ACTIVE [ 765.461962] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.462097] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.462153] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.462361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.462451] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.463249] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.463249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.463249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.463249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.463249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.463249] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.463249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.463557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.463557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.463557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.463637] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94424b02-85b8-4af0-a823-eda23fbba25f is going to be updated. [ 765.483160] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.483368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.483368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.483549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.483670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.483828] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94424b02-85b8-4af0-a823-eda23fbba25f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.725101] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e12e6f08-d99f-4fd3-9323-d04895bd2256: rpc.has_security_group_logging(os_id): False [ 765.741848] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.742054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.742151] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.742330] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.742421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.742642] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.742748] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.742842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.742936] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.743036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.743191] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.743277] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.743328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.743546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.743546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.743697] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.743918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.743997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.744156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.744224] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.744325] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 is going to be updated. [ 765.799407] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.799547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.799611] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.799844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.800058] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.813668] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: IN_PROGRESS for 2s [ 765.958603] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.463151] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.463151] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.463151] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.463151] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.463151] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.463151] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be created. [ 766.486619] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.486779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.486868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.487107] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.487279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.497452] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: UNINITIALIZED for 2s [ 766.813201] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 in Status: SUCCESS [ 766.813426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.159021] env[71140]: INFO networking_nsxv3.common.synchronization [req-4cf3134e-57d8-4de5-aeed-362feeab4121 req-cc0b75a6-1fd4-4964-bd0a-7d81c0e2d581 tempest-ImagesOneServerNegativeTestJSON-512607698 tempest-ImagesOneServerNegativeTestJSON-512607698-project-member] Enqueued Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 767.159021] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 767.159021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.159021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.159021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.159539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.159871] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.160124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.160294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.160551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.160839] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.161063] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.542666] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.543194] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-173" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.543194] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-173" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.543527] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-173" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.543799] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.543959] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.544091] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.544365] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.544450] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.544654] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.544766] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.544868] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.545021] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.545310] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.545506] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.545669] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.563029] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.563242] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 767.563375] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.563497] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-173" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.564545] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-1d44cea6-1a79-498b-951e-97a0c80ec3f2 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.564545] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-1d44cea6-1a79-498b-951e-97a0c80ec3f2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.564545] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-1d44cea6-1a79-498b-951e-97a0c80ec3f2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.564545] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-1d44cea6-1a79-498b-951e-97a0c80ec3f2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.564545] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d44cea6-1a79-498b-951e-97a0c80ec3f2',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.663259] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.664781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.664781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.664781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.664781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.664781] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.665062] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.665062] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.665218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.665324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.665431] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 already deleted. [ 767.665551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.827960] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: SUCCESS [ 767.828238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.070068] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.070068] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.070068] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.070068] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.070068] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.070068] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 1d44cea6-1a79-498b-951e-97a0c80ec3f2 not found, creating... [ 768.070068] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.070068] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.070068] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.070068] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.070534] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.070534] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.070534] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.070534] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.070534] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.070534] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.070534] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 1d44cea6-1a79-498b-951e-97a0c80ec3f2 is going to be created. [ 768.088380] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.088604] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.089899] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.090199] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.090428] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.090649] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-1d44cea6-1a79-498b-951e-97a0c80ec3f2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.506735] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 768.506969] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.507152] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.507415] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.507704] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.507827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.507893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.508140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.508140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.508221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.508311] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.858188] env[71140]: INFO networking_nsxv3.common.synchronization [req-4cf3134e-57d8-4de5-aeed-362feeab4121 req-14197bbd-89e3-4e15-ac36-dc981e5e1e3c service nova] Enqueued Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_rules [ 768.858445] env[71140]: INFO networking_nsxv3.common.synchronization [req-4cf3134e-57d8-4de5-aeed-362feeab4121 req-14197bbd-89e3-4e15-ac36-dc981e5e1e3c service nova] Enqueued Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 768.858514] env[71140]: INFO networking_nsxv3.common.synchronization [req-4cf3134e-57d8-4de5-aeed-362feeab4121 req-14197bbd-89e3-4e15-ac36-dc981e5e1e3c service nova] Enqueued Resource ID: 1d44cea6-1a79-498b-951e-97a0c80ec3f2 with Priority: HIGHEST for action port [ 768.858729] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_rules [ 768.858856] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 768.858979] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d44cea6-1a79-498b-951e-97a0c80ec3f2 with Priority: HIGHEST for action port [ 768.859538] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.859664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.859723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.860017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.861775] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.862944] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.863092] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.863167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.863330] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.863477] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.863571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.863634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.863773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.863858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.863944] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.864705] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d44cea6-1a79-498b-951e-97a0c80ec3f2 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.864804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d44cea6-1a79-498b-951e-97a0c80ec3f2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.864898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d44cea6-1a79-498b-951e-97a0c80ec3f2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.865055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d44cea6-1a79-498b-951e-97a0c80ec3f2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.865156] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d44cea6-1a79-498b-951e-97a0c80ec3f2',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.010455] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.010604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.010652] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.013263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.013533] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.013680] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.013745] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.013989] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.014047] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.014143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.014300] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.014407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.014485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.014639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.014801] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.014939] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.015060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.016171] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.016171] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.016171] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.016171] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.367363] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.367686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.369987] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.373020] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d44cea6-1a79-498b-951e-97a0c80ec3f2 with status ACTIVE [ 769.373020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.373020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.373020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.373020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.373020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.373020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.373020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.373020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.373020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.373020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.373020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.373020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.373020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.373020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.373542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.373542] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d44cea6-1a79-498b-951e-97a0c80ec3f2 is going to be updated. [ 769.394877] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.394877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.394877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.394877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.394877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.394877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d44cea6-1a79-498b-951e-97a0c80ec3f2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.520656] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c549bd3-468a-4655-b709-3480ff374e11: rpc.has_security_group_logging(os_id): False [ 769.551878] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.552071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.552153] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.552379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.552473] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.552775] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.552916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.553038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.553225] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.553259] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.553492] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.553607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.553699] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.553876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.553938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.558708] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.558708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.558708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.558708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.558708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.558708] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be created. [ 769.619171] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.619475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.619591] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.619828] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.620020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.641701] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 769.877067] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.379732] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.379928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.379928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.380191] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.380330] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.380431] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 is going to be created. [ 770.419021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.419021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.419021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.419021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.419021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.428625] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: UNINITIALIZED for 2s [ 771.652882] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 771.653202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.892606] env[71140]: INFO networking_nsxv3.common.synchronization [req-cd317893-3d19-4a49-8bb4-a6f910e18f99 req-a68c68fe-a22a-4985-b6ad-c7570782ffb1 tempest-InstanceActionsTestJSON-934591016 tempest-InstanceActionsTestJSON-934591016-project-member] Enqueued Resource ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 with Priority: HIGHEST for action security_group_members [ 771.893196] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 with Priority: HIGHEST for action security_group_members [ 771.893491] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a4b8219-796d-434e-a45e-ef4800a05c31 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.893610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.893682] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.893878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.898806] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.898992] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.899083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.899275] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.899369] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.899469] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a4b8219-796d-434e-a45e-ef4800a05c31',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.402382] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.402569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.402569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.402772] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.402870] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.403077] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.403178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.403290] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.403450] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.403621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.403621] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 is going to be updated. [ 772.432696] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.432907] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.432907] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.433373] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.433373] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.446983] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: SUCCESS [ 772.447330] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.447536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.447782] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.447938] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.448060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.448124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.448276] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.448353] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.448448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.448536] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.449847] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 in Status: IN_PROGRESS for 2s [ 772.950976] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.951327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.951327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.951418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.951579] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.951678] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.951741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.951888] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.951976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.952072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.952215] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.952304] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.952359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.952495] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.952626] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.952938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.952938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.952938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.953050] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.953050] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.953364] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.455936] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1100ce56-f855-47e4-96bb-f4bbe37e7632: rpc.has_security_group_logging(os_id): False [ 773.474801] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.475087] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.475087] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.475458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.475555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.475794] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.475913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.475993] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.476143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.476245] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.476442] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.476558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.476558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.476753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.476829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.477077] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.477233] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.477328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.477524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.477658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.477780] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 is going to be created. [ 773.534710] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.534710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.534710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.534710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.534710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.543240] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: IN_PROGRESS for 2s [ 773.758490] env[71140]: INFO networking_nsxv3.common.synchronization [req-06c583ca-2fa0-4183-a0a5-240a9b358c85 req-1480de01-86be-4df9-9db4-30181cb82cc2 tempest-ServersTestFqdnHostnames-630876233 tempest-ServersTestFqdnHostnames-630876233-project-member] Enqueued Resource ID: 55ee773a-5784-4390-9b7c-2b9d4342369e with Priority: HIGHEST for action security_group_members [ 773.759181] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55ee773a-5784-4390-9b7c-2b9d4342369e with Priority: HIGHEST for action security_group_members [ 773.759408] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-55ee773a-5784-4390-9b7c-2b9d4342369e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.759531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.759597] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.759884] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.759980] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.760121] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.760319] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.760582] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.761468] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.762081] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55ee773a-5784-4390-9b7c-2b9d4342369e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.124546] env[71140]: INFO networking_nsxv3.common.synchronization [req-8b1ac97e-6e12-4025-b836-4941d7982487 req-87477311-2ae5-4046-8a76-34e4b097fae7 tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 774.124546] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 774.125442] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.125641] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.125747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.126035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.126233] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.126366] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.126460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.126831] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.126831] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.126912] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.265099] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.265400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.265486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.265701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.265798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.266010] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.266118] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.266189] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.266327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.266404] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.266648] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55ee773a-5784-4390-9b7c-2b9d4342369e is going to be updated. [ 774.292367] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.292518] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.292604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.292816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.292963] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.300483] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55ee773a-5784-4390-9b7c-2b9d4342369e in Status: IN_PROGRESS for 2s [ 774.462442] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 in Status: SUCCESS [ 774.463429] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 deletion is rescheduled due to dependency. [ 774.463429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.486149] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-19 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.486368] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-19" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.486599] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-19" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.487088] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-19" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.487526] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.487784] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.487938] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.488242] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.488401] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.488678] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.488811] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 774.488937] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 774.489140] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 774.489335] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.489519] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 774.489733] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 774.505736] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 774.505931] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 774.506080] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 774.506263] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-19" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.506653] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-9a0573a5-045c-4af9-b58d-140fc5165ba1 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.506867] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-9a0573a5-045c-4af9-b58d-140fc5165ba1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.506991] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-9a0573a5-045c-4af9-b58d-140fc5165ba1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.507364] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-9a0573a5-045c-4af9-b58d-140fc5165ba1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.507550] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a0573a5-045c-4af9-b58d-140fc5165ba1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.633617] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.633788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.633871] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.634209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.634317] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.634620] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.634772] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.634814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.635174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.635174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.635174] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 already deleted. [ 774.635354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.010783] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.011052] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.011152] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.011434] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.011589] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.011746] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 9a0573a5-045c-4af9-b58d-140fc5165ba1 not found, creating... [ 775.012026] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.012187] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.012303] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.012514] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.012653] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.012928] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.013089] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.013206] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.013411] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.013543] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.013678] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 9a0573a5-045c-4af9-b58d-140fc5165ba1 is going to be created. [ 775.033940] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.034285] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.034500] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.034865] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.035187] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.035564] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-9a0573a5-045c-4af9-b58d-140fc5165ba1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.323880] env[71140]: INFO networking_nsxv3.common.synchronization [req-4c8b5687-8678-4ecc-a507-72b115271a9f req-5781b565-5ebf-4e2c-b2cf-04e9a22c028b tempest-DeleteServersTestJSON-1199867382 tempest-DeleteServersTestJSON-1199867382-project-member] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 775.324429] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 775.324835] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.326197] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.326296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.326514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.326745] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.326860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.326925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.327101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.327188] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.327284] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.554133] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: SUCCESS [ 775.554677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.761012] env[71140]: INFO networking_nsxv3.common.synchronization [req-8b1ac97e-6e12-4025-b836-4941d7982487 req-bc6325aa-0ef2-4ee6-af20-426245f29901 service nova] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_rules [ 775.761439] env[71140]: INFO networking_nsxv3.common.synchronization [req-8b1ac97e-6e12-4025-b836-4941d7982487 req-bc6325aa-0ef2-4ee6-af20-426245f29901 service nova] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 775.761439] env[71140]: INFO networking_nsxv3.common.synchronization [req-8b1ac97e-6e12-4025-b836-4941d7982487 req-bc6325aa-0ef2-4ee6-af20-426245f29901 service nova] Enqueued Resource ID: 9a0573a5-045c-4af9-b58d-140fc5165ba1 with Priority: HIGHEST for action port [ 775.762383] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_rules [ 775.762593] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 775.762834] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a0573a5-045c-4af9-b58d-140fc5165ba1 with Priority: HIGHEST for action port [ 775.763292] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.764088] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.764088] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.764088] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.764264] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.765505] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.765685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.765788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.766083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.766345] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.766498] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.766654] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.766946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.767043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.767184] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.768345] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a0573a5-045c-4af9-b58d-140fc5165ba1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.768492] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a0573a5-045c-4af9-b58d-140fc5165ba1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.768588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a0573a5-045c-4af9-b58d-140fc5165ba1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.768802] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a0573a5-045c-4af9-b58d-140fc5165ba1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.768919] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a0573a5-045c-4af9-b58d-140fc5165ba1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.829942] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.830190] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.830279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.830547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.830709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.830944] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.831096] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.831188] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.831399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.831510] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.831631] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be updated. [ 775.857930] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.858149] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.858149] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.858331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.858475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.866428] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 776.271357] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.271619] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.271875] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.273050] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a0573a5-045c-4af9-b58d-140fc5165ba1 with status ACTIVE [ 776.273246] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.273363] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.273429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.273642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.273727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.273917] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.274025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.274085] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.274655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.274655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.274655] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.274655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.274655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.274953] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.274953] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.274953] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a0573a5-045c-4af9-b58d-140fc5165ba1 is going to be updated. [ 776.307032] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.307032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.307032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.307032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.307032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.307032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a0573a5-045c-4af9-b58d-140fc5165ba1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.310774] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55ee773a-5784-4390-9b7c-2b9d4342369e in Status: SUCCESS [ 776.310922] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55ee773a-5784-4390-9b7c-2b9d4342369e deletion is rescheduled due to dependency. [ 776.311086] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.643635] env[71140]: INFO networking_nsxv3.common.synchronization [req-1abeceb2-d9b1-4874-b9f8-ba359d0465e6 req-6438a471-8ae5-491b-9aa9-759bf131aca3 tempest-ServersAdminTestJSON-2080308680 tempest-ServersAdminTestJSON-2080308680-project-member] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 776.643906] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 776.644178] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.644296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.644361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.644551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.645120] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.645228] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.645294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.645448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.645538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.645687] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.776760] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.955609] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-181 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.956418] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-181" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.956418] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-181" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.956418] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-181" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.956735] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.956735] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.956832] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.959586] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.959586] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.959586] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.959586] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.959586] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.959586] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.959586] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.959586] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.959586] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.976532] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.976730] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 776.976876] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.977066] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-181" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.977371] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-9a45ae91-24e6-4846-a399-d908b2f891e8 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.977583] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-9a45ae91-24e6-4846-a399-d908b2f891e8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.977674] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-9a45ae91-24e6-4846-a399-d908b2f891e8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.977990] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-9a45ae91-24e6-4846-a399-d908b2f891e8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.978144] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a45ae91-24e6-4846-a399-d908b2f891e8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.147282] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.282610] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.282699] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.282777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.283011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.283114] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.283225] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be created. [ 777.304093] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.305038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.305038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.305038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.305038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.314249] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: UNINITIALIZED for 2s [ 777.482840] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.483122] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.483272] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.483621] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.483793] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.483967] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 9a45ae91-24e6-4846-a399-d908b2f891e8 not found, creating... [ 777.484681] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.484681] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.484989] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.485120] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.485198] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.485564] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.485704] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.485864] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.486111] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.486279] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.486433] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 9a45ae91-24e6-4846-a399-d908b2f891e8 is going to be created. [ 777.504906] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.505155] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.505320] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.505610] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.505843] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.506085] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-9a45ae91-24e6-4846-a399-d908b2f891e8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.651429] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.875540] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 777.876329] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 deletion is rescheduled due to dependency. [ 777.876329] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.154128] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.154290] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.154404] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.154602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.154692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.155017] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be updated. [ 778.180856] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.181084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.181269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.182900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.182900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.190572] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: IN_PROGRESS for 2s [ 778.251399] env[71140]: INFO networking_nsxv3.common.synchronization [req-1abeceb2-d9b1-4874-b9f8-ba359d0465e6 req-73456c8f-4d6e-4e08-a2e8-9458d4fc3bae service nova] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_rules [ 778.251399] env[71140]: INFO networking_nsxv3.common.synchronization [req-1abeceb2-d9b1-4874-b9f8-ba359d0465e6 req-73456c8f-4d6e-4e08-a2e8-9458d4fc3bae service nova] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 778.251574] env[71140]: INFO networking_nsxv3.common.synchronization [req-1abeceb2-d9b1-4874-b9f8-ba359d0465e6 req-73456c8f-4d6e-4e08-a2e8-9458d4fc3bae service nova] Enqueued Resource ID: 9a45ae91-24e6-4846-a399-d908b2f891e8 with Priority: HIGHEST for action port [ 778.251698] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_rules [ 778.251860] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 778.252016] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a45ae91-24e6-4846-a399-d908b2f891e8 with Priority: HIGHEST for action port [ 778.253138] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.253256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.253348] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.253526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.253623] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.255433] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.255433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.255433] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a45ae91-24e6-4846-a399-d908b2f891e8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.255433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a45ae91-24e6-4846-a399-d908b2f891e8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.255433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a45ae91-24e6-4846-a399-d908b2f891e8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.255814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a45ae91-24e6-4846-a399-d908b2f891e8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.255814] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a45ae91-24e6-4846-a399-d908b2f891e8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.757296] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.757608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.760407] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a45ae91-24e6-4846-a399-d908b2f891e8 with status ACTIVE [ 778.760407] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.760407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.760407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.760407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.760637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.760637] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.760731] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.760787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.760941] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.761027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.761200] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.761288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.761400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.761488] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.761546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.762150] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a45ae91-24e6-4846-a399-d908b2f891e8 is going to be updated. [ 778.781888] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.782052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.782118] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.782320] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.782455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.782611] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a45ae91-24e6-4846-a399-d908b2f891e8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.233073] env[71140]: INFO networking_nsxv3.common.synchronization [req-d61cb10e-1706-47e7-a751-133f74d06489 req-f0183b9f-167d-4737-af2b-089d141c4190 tempest-ImagesOneServerTestJSON-1662922748 tempest-ImagesOneServerTestJSON-1662922748-project-member] Enqueued Resource ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 with Priority: HIGHEST for action security_group_members [ 779.233768] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 with Priority: HIGHEST for action security_group_members [ 779.234116] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.234250] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.234317] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.234554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.234787] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.235570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.235570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.235570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.235570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.235570] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2ad47d5-b746-415d-9e5e-05d9539a1fb9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.323370] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 779.323597] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.323759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.323985] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.324178] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.324294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.324357] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.324515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.324628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.324725] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.324816] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.625788] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-800 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.626009] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-800" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.626141] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-800" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.626465] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-800" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.627629] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.627629] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.627629] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.627629] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.627935] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.628021] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.628069] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.628174] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.628310] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.628425] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.628530] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.628664] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.647820] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.648872] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 779.648970] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.649161] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-800" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.649484] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-9343799c-53cd-4227-b90f-ddbb79d6af4c taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.649773] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-9343799c-53cd-4227-b90f-ddbb79d6af4c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.649773] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-9343799c-53cd-4227-b90f-ddbb79d6af4c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.650127] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-9343799c-53cd-4227-b90f-ddbb79d6af4c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.650272] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9343799c-53cd-4227-b90f-ddbb79d6af4c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.738890] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.739069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.739142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.739362] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.739470] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.739671] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.739772] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.739833] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.740010] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.740070] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.740159] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 already deleted. [ 779.740236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.829462] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.829462] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.829462] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.829800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.829800] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.829800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.829800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.829945] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.830244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.830244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.830389] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.830389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.830494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.830536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.830684] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.830768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.830815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.830953] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.831035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.831112] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.831197] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.155783] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.156908] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.160046] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.160046] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.160046] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.160046] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 9343799c-53cd-4227-b90f-ddbb79d6af4c not found, creating... [ 780.160046] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.160046] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.160046] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.160046] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.160046] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.160548] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.161073] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.161368] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.163711] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.163711] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.163711] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 9343799c-53cd-4227-b90f-ddbb79d6af4c is going to be created. [ 780.183114] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.183114] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.183114] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.183114] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.183114] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.183114] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-9343799c-53cd-4227-b90f-ddbb79d6af4c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.202024] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: SUCCESS [ 780.202024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.202024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.202024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.202024] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.202024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.202024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.202024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.202024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.202024] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.334262] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470: rpc.has_security_group_logging(os_id): False [ 780.358965] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.358965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.358965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.359219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.359303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.359575] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.359708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.359839] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.359943] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.360053] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.360399] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.360399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.360399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.360608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.360608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.360857] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.360954] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.361014] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.361163] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.361288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.361400] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be created. [ 780.424502] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.424843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.424843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.425157] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.425526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.436626] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 780.705782] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.934663] env[71140]: INFO networking_nsxv3.common.synchronization [req-d61cb10e-1706-47e7-a751-133f74d06489 req-7bbdc85a-24f4-4406-b024-dc40582d1f03 service nova] Enqueued Resource ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 with Priority: HIGHEST for action security_group_rules [ 780.934992] env[71140]: INFO networking_nsxv3.common.synchronization [req-d61cb10e-1706-47e7-a751-133f74d06489 req-7bbdc85a-24f4-4406-b024-dc40582d1f03 service nova] Enqueued Resource ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 with Priority: HIGHEST for action security_group_members [ 780.935050] env[71140]: INFO networking_nsxv3.common.synchronization [req-d61cb10e-1706-47e7-a751-133f74d06489 req-7bbdc85a-24f4-4406-b024-dc40582d1f03 service nova] Enqueued Resource ID: 9343799c-53cd-4227-b90f-ddbb79d6af4c with Priority: HIGHEST for action port [ 780.935739] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 with Priority: HIGHEST for action security_group_rules [ 780.935874] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 with Priority: HIGHEST for action security_group_members [ 780.938065] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9343799c-53cd-4227-b90f-ddbb79d6af4c with Priority: HIGHEST for action port [ 780.938376] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2ad47d5-b746-415d-9e5e-05d9539a1fb9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.938506] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.938577] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.938852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.938963] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2ad47d5-b746-415d-9e5e-05d9539a1fb9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.939885] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.940054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.940135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.940360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.940586] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.940702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.940769] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.940927] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.944443] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.944443] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2ad47d5-b746-415d-9e5e-05d9539a1fb9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.944443] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-9343799c-53cd-4227-b90f-ddbb79d6af4c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.944443] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9343799c-53cd-4227-b90f-ddbb79d6af4c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.944443] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9343799c-53cd-4227-b90f-ddbb79d6af4c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.944443] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9343799c-53cd-4227-b90f-ddbb79d6af4c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.944443] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9343799c-53cd-4227-b90f-ddbb79d6af4c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.208030] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.445020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.445020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.447507] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9343799c-53cd-4227-b90f-ddbb79d6af4c with status ACTIVE [ 781.447507] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.447699] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.447699] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.447869] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.447961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.448157] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.448258] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.448323] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.448483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.448562] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.448741] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.448835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.448937] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.449083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.449161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.449245] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9343799c-53cd-4227-b90f-ddbb79d6af4c is going to be updated. [ 781.450314] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2ad47d5-b746-415d-9e5e-05d9539a1fb9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.469990] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.470144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.470203] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.470353] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.470476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.470624] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9343799c-53cd-4227-b90f-ddbb79d6af4c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.710527] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.710709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.710801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.711254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.711435] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.711621] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be updated. [ 781.738679] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.738906] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.738993] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.739182] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.739325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.747885] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: IN_PROGRESS for 2s [ 781.952652] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2ad47d5-b746-415d-9e5e-05d9539a1fb9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.448665] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 782.448665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.458415] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.458623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.458623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.458789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.458960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.459182] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 is going to be created. [ 782.480553] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.480798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.480798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.480914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.481081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.489546] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 in Status: UNINITIALIZED for 2s [ 783.152977] env[71140]: INFO networking_nsxv3.common.synchronization [req-5ff0ec0f-3c34-45b9-9167-687acba4c735 req-96e9f01c-9096-4131-9f1c-9cdcfe966380 tempest-ServersTestManualDisk-1307284355 tempest-ServersTestManualDisk-1307284355-project-member] Enqueued Resource ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 with Priority: HIGHEST for action security_group_members [ 783.153547] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 with Priority: HIGHEST for action security_group_members [ 783.153863] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-604d5290-2f79-4d99-b6f1-1e0335d615a9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.153992] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.154070] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.154275] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.154427] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.154536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.154588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.154757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.154864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.154992] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('604d5290-2f79-4d99-b6f1-1e0335d615a9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.657149] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.657821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.657821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.657821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.657821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.658013] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.658013] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.658111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.658214] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.658292] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.658380] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 is going to be updated. [ 783.685185] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.685338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.685398] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.685599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.685740] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.693499] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 in Status: IN_PROGRESS for 2s [ 783.758222] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: SUCCESS [ 783.758222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.758222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.758222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.758222] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.758424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.758424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.758579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.758619] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.758745] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.758788] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.262049] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.262388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.262388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.262569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.264137] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.264137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.264137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.264137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.264137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.264137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.264137] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.264137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.264137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.264137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.264137] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.264560] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.264560] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.264560] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.264560] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.264666] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.264819] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.500608] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 in Status: SUCCESS [ 784.500608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.500879] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.500916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.501190] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.501622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.501622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.501816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.501919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.502074] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.502202] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2ad47d5-b746-415d-9e5e-05d9539a1fb9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.767535] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 184bb91c-9526-466a-820b-ced20908d98e: rpc.has_security_group_logging(os_id): False [ 784.796031] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.796031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.796031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.796031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.796031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.796031] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.796469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.796469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.796469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.796469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.796584] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.796724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.796774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.796926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.797010] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.797206] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.797352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.797352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.797493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.797564] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.797649] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be updated. [ 784.875785] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.875935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.876075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.877030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.877030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.887378] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: IN_PROGRESS for 2s [ 785.007089] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.007089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.007089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.007089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.007089] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.007089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.007089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.007460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.007460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.007460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.007548] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.007661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.007751] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.007942] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.008035] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.008115] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.008233] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.008310] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.008396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.008478] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.008579] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2ad47d5-b746-415d-9e5e-05d9539a1fb9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.476906] env[71140]: INFO networking_nsxv3.common.synchronization [req-da7cc114-2da1-486e-8e4b-b704f04b2d76 req-25a85ef2-e434-42de-98bd-55a49e7c48ba tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 785.477277] env[71140]: INFO networking_nsxv3.common.synchronization [req-da7cc114-2da1-486e-8e4b-b704f04b2d76 req-25a85ef2-e434-42de-98bd-55a49e7c48ba tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGHEST for action security_group_members [ 785.478130] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 785.478281] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGHEST for action security_group_members [ 785.478574] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.478706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.478772] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.479176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.479398] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.479475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.479516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.479662] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.479752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.479845] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.480677] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30d81b57-1e7d-4b6c-8223-18f586dd832a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.480786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.480853] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.481440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.485018] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.485018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.485018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.485018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.485018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.485018] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.510238] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2ad47d5-b746-415d-9e5e-05d9539a1fb9: rpc.has_security_group_logging(os_id): False [ 785.521112] env[71140]: INFO networking_nsxv3.common.synchronization [req-da7cc114-2da1-486e-8e4b-b704f04b2d76 req-25a85ef2-e434-42de-98bd-55a49e7c48ba tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGHEST for action security_group_rules [ 785.521361] env[71140]: INFO networking_nsxv3.common.synchronization [req-da7cc114-2da1-486e-8e4b-b704f04b2d76 req-25a85ef2-e434-42de-98bd-55a49e7c48ba tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGHEST for action security_group_members [ 785.521419] env[71140]: INFO networking_nsxv3.common.synchronization [req-da7cc114-2da1-486e-8e4b-b704f04b2d76 req-25a85ef2-e434-42de-98bd-55a49e7c48ba tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_rules [ 785.521548] env[71140]: INFO networking_nsxv3.common.synchronization [req-da7cc114-2da1-486e-8e4b-b704f04b2d76 req-25a85ef2-e434-42de-98bd-55a49e7c48ba tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 785.521672] env[71140]: INFO networking_nsxv3.common.synchronization [req-da7cc114-2da1-486e-8e4b-b704f04b2d76 req-25a85ef2-e434-42de-98bd-55a49e7c48ba tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 9a0573a5-045c-4af9-b58d-140fc5165ba1 with Priority: HIGHEST for action port [ 785.522158] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGHEST for action security_group_rules [ 785.522287] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_rules [ 785.522383] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a0573a5-045c-4af9-b58d-140fc5165ba1 with Priority: HIGHEST for action port [ 785.522528] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGHEST for action security_group_members [ 785.522568] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 785.523754] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30d81b57-1e7d-4b6c-8223-18f586dd832a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.523754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.523754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.523754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.523754] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.527923] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.527923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.527923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.527923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.527923] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.527923] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a0573a5-045c-4af9-b58d-140fc5165ba1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.527923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a0573a5-045c-4af9-b58d-140fc5165ba1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.527923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a0573a5-045c-4af9-b58d-140fc5165ba1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.527923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a0573a5-045c-4af9-b58d-140fc5165ba1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.527923] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a0573a5-045c-4af9-b58d-140fc5165ba1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.528442] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30d81b57-1e7d-4b6c-8223-18f586dd832a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.528599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.528711] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.528790] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.529789] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.529913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.529978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.530161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.530246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.530438] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.530528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.530585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.530724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.530798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.530970] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.531071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.531172] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.531264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.531335] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.531522] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.531601] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.531668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.531800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.531870] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.531950] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 is going to be created. [ 785.586658] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.586902] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.586983] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.587245] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.587574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.598497] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 in Status: IN_PROGRESS for 2s [ 785.704101] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 in Status: SUCCESS [ 785.704101] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 604d5290-2f79-4d99-b6f1-1e0335d615a9 deletion is rescheduled due to dependency. [ 785.704101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-604d5290-2f79-4d99-b6f1-1e0335d615a9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.985510] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.985510] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.026037] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30d81b57-1e7d-4b6c-8223-18f586dd832a taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.026037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.027556] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.027556] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.032019] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a0573a5-045c-4af9-b58d-140fc5165ba1 with status ACTIVE [ 786.032019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.032019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.032019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.032019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.032019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.032019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.032019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.032019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.032019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.032019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.032019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.032019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.032019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.032019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.032570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.032570] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a0573a5-045c-4af9-b58d-140fc5165ba1 is going to be updated. [ 786.054765] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.054765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.054765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.054765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.054765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.054765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a0573a5-045c-4af9-b58d-140fc5165ba1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.247357] env[71140]: INFO networking_nsxv3.common.synchronization [req-b4b4bfe9-14da-454e-a471-6cbd65d6524f req-7c8795f7-2963-42e4-aa6a-7c510fc7934f tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 with Priority: HIGHEST for action security_group_members [ 786.247571] env[71140]: INFO networking_nsxv3.common.synchronization [req-b4b4bfe9-14da-454e-a471-6cbd65d6524f req-7c8795f7-2963-42e4-aa6a-7c510fc7934f tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 786.247571] env[71140]: INFO networking_nsxv3.common.synchronization [req-b4b4bfe9-14da-454e-a471-6cbd65d6524f req-7c8795f7-2963-42e4-aa6a-7c510fc7934f tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGHEST for action security_group_members [ 786.248140] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 with Priority: HIGHEST for action security_group_members [ 786.248362] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 786.248412] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGHEST for action security_group_members [ 786.248643] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.248858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.248858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.249125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.249290] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.249388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.249449] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.249597] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.249682] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.249779] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4143c3a0-53e5-4025-8a89-c9d1e7dbb668',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.250594] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.250682] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.250863] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30d81b57-1e7d-4b6c-8223-18f586dd832a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.250956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.296901] env[71140]: INFO networking_nsxv3.common.synchronization [req-b4b4bfe9-14da-454e-a471-6cbd65d6524f req-7c8795f7-2963-42e4-aa6a-7c510fc7934f tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGHEST for action security_group_rules [ 786.297097] env[71140]: INFO networking_nsxv3.common.synchronization [req-b4b4bfe9-14da-454e-a471-6cbd65d6524f req-7c8795f7-2963-42e4-aa6a-7c510fc7934f tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGHEST for action security_group_members [ 786.297236] env[71140]: INFO networking_nsxv3.common.synchronization [req-b4b4bfe9-14da-454e-a471-6cbd65d6524f req-7c8795f7-2963-42e4-aa6a-7c510fc7934f tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 with Priority: HIGHEST for action security_group_rules [ 786.297368] env[71140]: INFO networking_nsxv3.common.synchronization [req-b4b4bfe9-14da-454e-a471-6cbd65d6524f req-7c8795f7-2963-42e4-aa6a-7c510fc7934f tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 with Priority: HIGHEST for action security_group_members [ 786.297493] env[71140]: INFO networking_nsxv3.common.synchronization [req-b4b4bfe9-14da-454e-a471-6cbd65d6524f req-7c8795f7-2963-42e4-aa6a-7c510fc7934f tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_rules [ 786.297641] env[71140]: INFO networking_nsxv3.common.synchronization [req-b4b4bfe9-14da-454e-a471-6cbd65d6524f req-7c8795f7-2963-42e4-aa6a-7c510fc7934f tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 786.297767] env[71140]: INFO networking_nsxv3.common.synchronization [req-b4b4bfe9-14da-454e-a471-6cbd65d6524f req-7c8795f7-2963-42e4-aa6a-7c510fc7934f tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 9a0573a5-045c-4af9-b58d-140fc5165ba1 with Priority: HIGHEST for action port [ 786.298262] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGHEST for action security_group_rules [ 786.298396] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 with Priority: HIGHEST for action security_group_rules [ 786.298495] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 786.298575] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a0573a5-045c-4af9-b58d-140fc5165ba1 with Priority: HIGHEST for action port [ 786.298663] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_rules [ 786.298741] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGHEST for action security_group_members [ 786.298826] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 with Priority: HIGHEST for action security_group_members [ 786.299168] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30d81b57-1e7d-4b6c-8223-18f586dd832a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.299315] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.299447] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4143c3a0-53e5-4025-8a89-c9d1e7dbb668 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.299545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.299604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.299853] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.299938] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4143c3a0-53e5-4025-8a89-c9d1e7dbb668',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.303964] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.303964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.303964] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a0573a5-045c-4af9-b58d-140fc5165ba1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.303964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a0573a5-045c-4af9-b58d-140fc5165ba1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.303964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a0573a5-045c-4af9-b58d-140fc5165ba1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.303964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a0573a5-045c-4af9-b58d-140fc5165ba1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.303964] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a0573a5-045c-4af9-b58d-140fc5165ba1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.303964] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.303964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.303964] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30d81b57-1e7d-4b6c-8223-18f586dd832a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.303964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.303964] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.303964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.487349] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.493119] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.752718] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4143c3a0-53e5-4025-8a89-c9d1e7dbb668',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.804444] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.804690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.806063] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a0573a5-045c-4af9-b58d-140fc5165ba1 with status ACTIVE [ 786.806275] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.806390] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.806458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.806734] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.806838] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.807042] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.807161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.807335] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.807403] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.807973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.807973] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.807973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.807973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.808229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.808229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.808229] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a0573a5-045c-4af9-b58d-140fc5165ba1 is going to be updated. [ 786.827766] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.827898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.827898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.828134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.828357] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.828484] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a0573a5-045c-4af9-b58d-140fc5165ba1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.913212] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: SUCCESS [ 786.913212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.990200] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.990200] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.990326] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.990499] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.990621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.990739] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a is going to be created. [ 786.995421] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.995604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.995649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.995859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.995958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.996067] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 787.024017] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.024017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.024017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.024017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.024248] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.031628] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.031822] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.031822] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.032048] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.032185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.034569] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a in Status: UNINITIALIZED for 2s [ 787.038983] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 787.255767] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4143c3a0-53e5-4025-8a89-c9d1e7dbb668',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.611513] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 in Status: SUCCESS [ 787.611513] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.759534] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.759807] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.759906] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.760365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.760510] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.760647] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 is going to be created. [ 787.783038] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.784148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.784278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.784538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.785941] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.795421] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 in Status: UNINITIALIZED for 2s [ 788.541363] env[71140]: INFO networking_nsxv3.common.synchronization [req-f8624c6e-809f-4ad5-88c9-3a64d8c87e50 req-a5236ad3-4095-425c-adce-f3f2d09c4774 tempest-FloatingIPsAssociationTestJSON-945479351 tempest-FloatingIPsAssociationTestJSON-945479351-project-member] Enqueued Resource ID: f9ec394c-128b-4456-9eb1-76442418ea09 with Priority: HIGHEST for action security_group_members [ 788.541725] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ec394c-128b-4456-9eb1-76442418ea09 with Priority: HIGHEST for action security_group_members [ 788.542022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ec394c-128b-4456-9eb1-76442418ea09 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.542520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.542627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.544701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.547233] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.547470] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.547470] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.548117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.548117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.548117] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.942938] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-952 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.943252] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-952" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.943379] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-952" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.943671] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-952" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.945187] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.945187] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.945187] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.945187] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.945187] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.945452] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 788.945452] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.945452] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.945540] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.945723] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 788.945764] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.945896] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.963970] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.964162] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 788.964299] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.964477] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-952" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.964902] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-d78b9581-1313-402e-a183-e90148f82ceb taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.965163] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-d78b9581-1313-402e-a183-e90148f82ceb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.965299] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-d78b9581-1313-402e-a183-e90148f82ceb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.965594] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-d78b9581-1313-402e-a183-e90148f82ceb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.965734] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d78b9581-1313-402e-a183-e90148f82ceb',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.044542] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a in Status: SUCCESS [ 789.044542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.044676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.044801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.045105] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.045105] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.045220] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.045329] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.045415] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.045510] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.046951] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 789.047659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.051020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.051020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.051020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.051020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.051020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.051020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.051020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.051020] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.055124] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.055237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.055310] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.055483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.055569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.056341] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.056341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.056341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.056341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.056341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.056341] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9ec394c-128b-4456-9eb1-76442418ea09 already deleted. [ 789.056341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.468120] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.468120] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.468274] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.468517] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.468670] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.468825] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port d78b9581-1313-402e-a183-e90148f82ceb not found, creating... [ 789.469163] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.469353] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.469601] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.469698] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.469840] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.470147] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.470301] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.470416] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.470806] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.470933] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.471106] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: d78b9581-1313-402e-a183-e90148f82ceb is going to be created. [ 789.491664] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.491872] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.492063] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.492337] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.492563] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.492779] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-d78b9581-1313-402e-a183-e90148f82ceb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.550510] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.552712] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.806156] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 in Status: SUCCESS [ 789.806438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.806681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.806906] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.807139] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.807268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.807334] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.807494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.807578] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.807694] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4143c3a0-53e5-4025-8a89-c9d1e7dbb668',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.055172] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.058949] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.260837] env[71140]: INFO networking_nsxv3.common.synchronization [req-f8624c6e-809f-4ad5-88c9-3a64d8c87e50 req-6801c68e-0778-4c42-a569-9928be9a5b8e service nova] Enqueued Resource ID: f9ec394c-128b-4456-9eb1-76442418ea09 with Priority: HIGHEST for action security_group_rules [ 790.261039] env[71140]: INFO networking_nsxv3.common.synchronization [req-f8624c6e-809f-4ad5-88c9-3a64d8c87e50 req-6801c68e-0778-4c42-a569-9928be9a5b8e service nova] Enqueued Resource ID: f9ec394c-128b-4456-9eb1-76442418ea09 with Priority: HIGHEST for action security_group_members [ 790.261196] env[71140]: INFO networking_nsxv3.common.synchronization [req-f8624c6e-809f-4ad5-88c9-3a64d8c87e50 req-6801c68e-0778-4c42-a569-9928be9a5b8e service nova] Enqueued Resource ID: d78b9581-1313-402e-a183-e90148f82ceb with Priority: HIGHEST for action port [ 790.261424] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ec394c-128b-4456-9eb1-76442418ea09 with Priority: HIGHEST for action security_group_rules [ 790.261550] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ec394c-128b-4456-9eb1-76442418ea09 with Priority: HIGHEST for action security_group_members [ 790.261642] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d78b9581-1313-402e-a183-e90148f82ceb with Priority: HIGHEST for action port [ 790.264730] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9ec394c-128b-4456-9eb1-76442418ea09 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.264874] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.264965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.265304] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.265440] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.266344] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ec394c-128b-4456-9eb1-76442418ea09 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.266455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.266578] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.266962] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.266962] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.267159] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.267159] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.267261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.267309] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.267444] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.268543] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-d78b9581-1313-402e-a183-e90148f82ceb taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.269374] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d78b9581-1313-402e-a183-e90148f82ceb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.269430] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d78b9581-1313-402e-a183-e90148f82ceb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.273417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d78b9581-1313-402e-a183-e90148f82ceb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.273417] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d78b9581-1313-402e-a183-e90148f82ceb',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.310206] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4143c3a0-53e5-4025-8a89-c9d1e7dbb668',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.561530] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.561530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.561530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.561530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.561530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.561530] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a is going to be updated. [ 790.563768] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.563932] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.563997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.564602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.564602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.564602] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 790.588205] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.588381] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.588381] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.588535] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.589749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.591907] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.592051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.592139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.592341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.592479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.601659] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 790.602556] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a in Status: IN_PROGRESS for 2s [ 790.774842] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.775523] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ec394c-128b-4456-9eb1-76442418ea09 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.775662] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.776044] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d78b9581-1313-402e-a183-e90148f82ceb with status ACTIVE [ 790.776241] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.776366] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.777798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.777798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.777798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.777798] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.777798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.777798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.777798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.777798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.777798] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.777798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.777798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.777798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.777798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.778285] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d78b9581-1313-402e-a183-e90148f82ceb is going to be updated. [ 790.801075] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.801075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.801075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.801075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.801075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.801075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d78b9581-1313-402e-a183-e90148f82ceb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.813691] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4143c3a0-53e5-4025-8a89-c9d1e7dbb668',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.181856] env[71140]: INFO networking_nsxv3.common.synchronization [req-657ca5f2-01f5-4592-8dbe-9c507c86c848 req-ecefafff-2cec-41f0-9269-b834f9a5b746 tempest-ServersTestMultiNic-1825947710 tempest-ServersTestMultiNic-1825947710-project-member] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 791.182399] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 791.182701] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.182816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.182885] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.183728] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.183889] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.183992] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.184076] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.184498] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.184605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.184728] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.277283] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.321632] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.321632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.322038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.322038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.322038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.322165] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 is going to be updated. [ 791.352269] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.352269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.352269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.352269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.352269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.361685] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 in Status: IN_PROGRESS for 2s [ 791.488717] env[71140]: INFO networking_nsxv3.common.synchronization [req-3dad9207-d173-43e1-92e9-db8c617790ac req-5c892a35-6768-4e41-9462-1a93f01ba8ed tempest-ListServerFiltersTestJSON-1641915528 tempest-ListServerFiltersTestJSON-1641915528-project-member] Enqueued Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 791.491699] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 791.495498] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.495649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.495745] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.496063] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.496266] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.496421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.496518] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.497022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.497022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.497022] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.580298] env[71140]: INFO networking_nsxv3.common.synchronization [req-5a22d0dd-8f8b-462f-ad6d-2e043fca37a4 req-e535b390-221e-4399-9f4a-f67aa4b811b0 tempest-ImagesOneServerNegativeTestJSON-512607698 tempest-ImagesOneServerNegativeTestJSON-512607698-project-member] Enqueued Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 791.583702] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 791.584244] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.585525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.585525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.585525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.585525] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.585525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.585525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.585525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.585525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.585525] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.690282] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.690562] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.690677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.690995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.691151] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.691392] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.691499] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.691566] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.691719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.691802] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.691894] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e already deleted. [ 791.692090] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.780824] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.781065] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.781170] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.781460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.781589] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.781732] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9ec394c-128b-4456-9eb1-76442418ea09 is going to be created. [ 791.806194] env[71140]: INFO networking_nsxv3.common.synchronization [req-657ca5f2-01f5-4592-8dbe-9c507c86c848 req-bc3e900a-0de8-4a0a-9de5-bd13484fc37f tempest-ServersTestMultiNic-1825947710 tempest-ServersTestMultiNic-1825947710-project-member] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 791.806560] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 791.807301] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.807301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.807301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.808356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.808356] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.808356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.808356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.808356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.808356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.808601] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.875101] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.875268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.875318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.877021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.877021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.885328] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9ec394c-128b-4456-9eb1-76442418ea09 in Status: UNINITIALIZED for 2s [ 792.004584] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.087684] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.087860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.087925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.088180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.088299] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.088467] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.088582] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.088622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.088772] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.088849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.088936] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 is going to be updated. [ 792.116470] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.116712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.116805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.117031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.117181] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.125700] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: IN_PROGRESS for 2s [ 792.197583] env[71140]: INFO networking_nsxv3.common.synchronization [req-657ca5f2-01f5-4592-8dbe-9c507c86c848 req-63f62983-1843-4242-a131-96f25bd39514 tempest-ServersTestMultiNic-1825947710 tempest-ServersTestMultiNic-1825947710-project-member] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 792.198249] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 792.198622] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.198740] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.311542] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.311741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.311796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.311982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.312110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.314023] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.314023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.314023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.314023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.314023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.314023] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e already deleted. [ 792.314023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.314023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.314023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.314023] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.314023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.314023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.314023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.314023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.314023] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.507974] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.615910] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a in Status: SUCCESS [ 792.615910] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.616473] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 792.616710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.616946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.617272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.618039] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.618039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.618039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.618039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.618039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.621038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.621230] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.623078] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.626025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.626025] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.626025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.626025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.626025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.626025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.626025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.626025] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.626025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.627231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.627231] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.627231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.627231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.627231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.627231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.628127] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.630037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.630037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.630172] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.630253] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.630518] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.630715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.630816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.630951] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.667300] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-355 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.667487] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-355" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.667610] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-355" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.667985] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-355" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.668288] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.668447] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.668561] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.668785] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.669604] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.669905] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.670054] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.670175] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.670287] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.670414] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.670523] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.670662] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.715699] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.715699] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 792.715848] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.716045] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-355" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.716379] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-1b8e4e3d-195a-4744-bc6f-3f46cff3af92 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.717757] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-1b8e4e3d-195a-4744-bc6f-3f46cff3af92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.717757] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-1b8e4e3d-195a-4744-bc6f-3f46cff3af92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.720834] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-1b8e4e3d-195a-4744-bc6f-3f46cff3af92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.721369] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b8e4e3d-195a-4744-bc6f-3f46cff3af92',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.820579] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.820579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.820579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.820579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.820579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.820579] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.820579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.820579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.820579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.820579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.820579] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e already deleted. [ 792.820579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.011974] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.012167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.012240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.012450] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.012620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.012668] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 is going to be updated. [ 793.038942] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.039110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.039175] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.039424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.039572] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.047068] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: IN_PROGRESS for 2s [ 793.127515] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.133038] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.133209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.133374] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.134473] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.223925] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.224227] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.224363] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.224764] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.225021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.225267] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 1b8e4e3d-195a-4744-bc6f-3f46cff3af92 not found, creating... [ 793.225646] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.225868] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.226087] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.226475] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.226638] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.227404] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.227680] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.227880] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.228237] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.228436] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.229214] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 1b8e4e3d-195a-4744-bc6f-3f46cff3af92 is going to be created. [ 793.262026] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.262026] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.262026] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.265160] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.265160] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.265160] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-1b8e4e3d-195a-4744-bc6f-3f46cff3af92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.376214] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 in Status: SUCCESS [ 793.376755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.376755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.376959] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.377168] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.377287] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.377349] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.377507] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.377617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.378284] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.378284] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4143c3a0-53e5-4025-8a89-c9d1e7dbb668',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.629219] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30d81b57-1e7d-4b6c-8223-18f586dd832a: rpc.has_security_group_logging(os_id): False [ 793.639220] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.639505] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.657388] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.657564] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.657674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.657950] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.658075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.658422] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.658529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.658602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.659590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.659590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.659590] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a is going to be created. [ 793.722246] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.722246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.722246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.722246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.722246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.735243] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a in Status: IN_PROGRESS for 2s [ 793.880364] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4143c3a0-53e5-4025-8a89-c9d1e7dbb668',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.895740] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9ec394c-128b-4456-9eb1-76442418ea09 in Status: SUCCESS [ 793.895861] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.896393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.896393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.896575] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.896575] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.896733] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.896839] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.896924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.897024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.897120] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.996822] env[71140]: INFO networking_nsxv3.common.synchronization [req-91ddc6f1-8dfe-4a6f-b1f2-75cafbe36a1c req-0969389d-6d60-4c43-839f-7d5a1cee8e98 tempest-ListServersNegativeTestJSON-2012900449 tempest-ListServersNegativeTestJSON-2012900449-project-member] Enqueued Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 793.997394] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 793.997710] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.997900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.997900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.999398] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.999527] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.999527] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.999667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.999755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.999861] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.999958] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.090180] env[71140]: INFO networking_nsxv3.common.synchronization [req-2fe6425c-e22d-4586-bb24-4bb34bbb83b8 req-0d9261fa-fcef-4775-83f1-3b40c0f53bae tempest-ListServersNegativeTestJSON-2012900449 tempest-ListServersNegativeTestJSON-2012900449-project-member] Enqueued Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 794.090887] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 with Priority: HIGHEST for action security_group_members [ 794.091100] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12e6f08-d99f-4fd3-9323-d04895bd2256 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.091203] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.135173] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: SUCCESS [ 794.135350] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 deletion is rescheduled due to dependency. [ 794.135460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.140891] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.141519] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.141519] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.141519] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.141668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.141668] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a is going to be updated. [ 794.145174] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.145174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.145174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.145174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.145174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.145174] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 794.169403] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.169552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.169628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.169884] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.170032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.171816] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.171922] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.171996] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.172354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.172674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.182234] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a in Status: IN_PROGRESS for 2s [ 794.183263] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 794.383683] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4143c3a0-53e5-4025-8a89-c9d1e7dbb668: rpc.has_security_group_logging(os_id): False [ 794.400795] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.401059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.401269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.401604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.401712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.401960] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.402079] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.402142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.402303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.402383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.402596] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 is going to be created. [ 794.410433] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ec394c-128b-4456-9eb1-76442418ea09 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.410640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.410640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.410959] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.411266] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.411365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.411401] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.411595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.411674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.411755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.411877] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ec394c-128b-4456-9eb1-76442418ea09 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.411970] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.412041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.412186] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.412321] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.412410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.412472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.412609] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.412687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.412771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.412864] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.462766] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.462961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.462961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.463388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.463388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.475348] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 in Status: IN_PROGRESS for 2s [ 794.502978] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.664331] env[71140]: INFO networking_nsxv3.common.synchronization [req-657ca5f2-01f5-4592-8dbe-9c507c86c848 req-b03ad320-5738-47c5-8ad8-3c9d51f027ef service nova] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_rules [ 794.664497] env[71140]: INFO networking_nsxv3.common.synchronization [req-657ca5f2-01f5-4592-8dbe-9c507c86c848 req-b03ad320-5738-47c5-8ad8-3c9d51f027ef service nova] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 794.664651] env[71140]: INFO networking_nsxv3.common.synchronization [req-657ca5f2-01f5-4592-8dbe-9c507c86c848 req-b03ad320-5738-47c5-8ad8-3c9d51f027ef service nova] Enqueued Resource ID: 1b8e4e3d-195a-4744-bc6f-3f46cff3af92 with Priority: HIGHEST for action port [ 794.664905] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_rules [ 794.665039] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 794.666033] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b8e4e3d-195a-4744-bc6f-3f46cff3af92 with Priority: HIGHEST for action port [ 794.666033] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.666033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.666033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.668834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.668948] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.670014] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.670134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.670197] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.670391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.670543] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.670635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.670706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.670842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.670925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.671028] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.672218] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b8e4e3d-195a-4744-bc6f-3f46cff3af92 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.672298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b8e4e3d-195a-4744-bc6f-3f46cff3af92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.672298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b8e4e3d-195a-4744-bc6f-3f46cff3af92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.672467] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b8e4e3d-195a-4744-bc6f-3f46cff3af92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.672534] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b8e4e3d-195a-4744-bc6f-3f46cff3af92',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.917353] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9ec394c-128b-4456-9eb1-76442418ea09: rpc.has_security_group_logging(os_id): False [ 794.929372] env[71140]: INFO networking_nsxv3.common.synchronization [None req-f6898eb5-a97a-4f76-8de3-de3e842c3b38 None None] Enqueued Resource ID: 0ce90e49-c39d-4b16-868d-fd28ac9def4b with Priority: HIGHEST for action port [ 794.930073] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce90e49-c39d-4b16-868d-fd28ac9def4b with Priority: HIGHEST for action port [ 794.930437] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ce90e49-c39d-4b16-868d-fd28ac9def4b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.930617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ce90e49-c39d-4b16-868d-fd28ac9def4b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.930738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ce90e49-c39d-4b16-868d-fd28ac9def4b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.933326] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ce90e49-c39d-4b16-868d-fd28ac9def4b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.933452] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ce90e49-c39d-4b16-868d-fd28ac9def4b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.937295] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.937295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.937295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.937295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.937295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.937295] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.937295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.937295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.937295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.937295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.937295] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.937295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.937295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.937790] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.942043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.942043] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.942043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.942043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.942043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.942043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.942043] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9ec394c-128b-4456-9eb1-76442418ea09 is going to be created. [ 794.944269] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ce90e49-c39d-4b16-868d-fd28ac9def4b [ 794.945017] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.945017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.945017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.945017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.945017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.945017] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ce90e49-c39d-4b16-868d-fd28ac9def4b already deleted. [ 794.945017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ce90e49-c39d-4b16-868d-fd28ac9def4b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.997762] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.998142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.998297] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.998588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.998901] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.006984] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.012778] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9ec394c-128b-4456-9eb1-76442418ea09 in Status: IN_PROGRESS for 2s [ 795.057653] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: SUCCESS [ 795.057653] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.174304] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.176037] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.176201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.181022] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b8e4e3d-195a-4744-bc6f-3f46cff3af92 with status ACTIVE [ 795.181022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.181022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.181022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.181022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.181022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.181022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.181022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.181022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.181022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.181022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.181022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.181022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.181022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.181022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.181642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.181642] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b8e4e3d-195a-4744-bc6f-3f46cff3af92 is going to be updated. [ 795.227044] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.227238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.228118] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.228118] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.228118] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.228118] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b8e4e3d-195a-4744-bc6f-3f46cff3af92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.508662] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.509044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.509044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.509872] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.509872] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.509872] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 is going to be updated. [ 795.539426] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.539426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.539426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.539426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.539426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.548073] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: IN_PROGRESS for 2s [ 795.679478] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.751026] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a in Status: SUCCESS [ 795.751026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.751026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.751026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.751026] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.772632] env[71140]: INFO networking_nsxv3.common.synchronization [req-7fcf4783-55bb-439d-abca-83779dd7f28b req-375d50c1-c125-44b4-b079-cd8a5ed2ddba tempest-MigrationsAdminTest-2143534678 tempest-MigrationsAdminTest-2143534678-project-member] Enqueued Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGHEST for action security_group_members [ 795.773859] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGHEST for action security_group_members [ 795.774726] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.774929] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.775023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.775224] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.775713] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.775852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.776806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.778061] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.778366] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.778492] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.940090] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.940346] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-267" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.940476] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-267" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.940822] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-267" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.942718] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.942978] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.943132] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.943424] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.943578] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.943816] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 795.943944] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 795.944077] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 795.944192] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 795.944314] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 795.944420] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 795.944571] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 795.972175] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 795.972175] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 795.972175] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 795.972175] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-267" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.972175] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-5cee26b7-18e1-4185-968f-6579953fa936 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.972892] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-5cee26b7-18e1-4185-968f-6579953fa936" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.972892] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-5cee26b7-18e1-4185-968f-6579953fa936" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.972892] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-5cee26b7-18e1-4185-968f-6579953fa936" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.973114] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cee26b7-18e1-4185-968f-6579953fa936',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.184021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.184021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.184021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.184021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.184021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.184021] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be created. [ 796.206479] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a in Status: SUCCESS [ 796.206479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.206479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.206479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.206479] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.206479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.206479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.206479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.206479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.206479] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.211026] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 796.211026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.211026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.211026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.211026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.211026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.211026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.211026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.211026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.211026] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.223243] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.223369] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.223411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.223617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.223789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.238735] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: UNINITIALIZED for 2s [ 796.254711] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30d81b57-1e7d-4b6c-8223-18f586dd832a taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.254711] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.283700] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.297162] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.297387] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.297510] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.299549] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.300024] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.300146] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.300265] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.300571] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.300783] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.301064] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.301187] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.301294] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.301404] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.301591] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.301649] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.301744] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.325028] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.325265] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 796.325421] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.325603] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.325967] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.326195] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.326335] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.326691] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.326847] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.476144] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.476410] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.476540] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.476880] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.477049] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.477231] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 5cee26b7-18e1-4185-968f-6579953fa936 not found, creating... [ 796.477616] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.477833] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.478084] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.478201] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.478339] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.479677] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.479912] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.480084] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.480417] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.480482] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.480592] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 5cee26b7-18e1-4185-968f-6579953fa936 is going to be created. [ 796.498072] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 in Status: SUCCESS [ 796.498072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.503507] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.503911] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.503911] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.504251] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.504508] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.504755] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-5cee26b7-18e1-4185-968f-6579953fa936" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.707811] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.712673] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.787586] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.830789] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.831090] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.831225] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.831516] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.831669] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.831826] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa not found, creating... [ 796.832125] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.832307] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.832423] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.832663] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.832801] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.833234] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.833386] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.833386] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.833560] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.833688] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.833830] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa is going to be created. [ 796.855394] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.855602] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.855916] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.856744] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.857029] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.857267] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.881044] env[71140]: INFO networking_nsxv3.common.synchronization [None req-1f5549d5-207b-4c45-a5bc-77a9638a761a None None] Enqueued Resource ID: b10adf43-641a-4919-9beb-96c8450b7197 with Priority: HIGHEST for action port [ 796.881044] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b10adf43-641a-4919-9beb-96c8450b7197 with Priority: HIGHEST for action port [ 796.881044] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-b10adf43-641a-4919-9beb-96c8450b7197 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.881044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b10adf43-641a-4919-9beb-96c8450b7197" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.881044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b10adf43-641a-4919-9beb-96c8450b7197" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.881044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b10adf43-641a-4919-9beb-96c8450b7197" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.881044] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b10adf43-641a-4919-9beb-96c8450b7197',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.027356] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9ec394c-128b-4456-9eb1-76442418ea09 in Status: SUCCESS [ 797.027692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.210321] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.215175] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.250412] env[71140]: INFO networking_nsxv3.common.synchronization [req-657ca5f2-01f5-4592-8dbe-9c507c86c848 req-e819ef9b-d05f-433a-b05f-6f577206cdff service nova] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_rules [ 797.250412] env[71140]: INFO networking_nsxv3.common.synchronization [req-657ca5f2-01f5-4592-8dbe-9c507c86c848 req-e819ef9b-d05f-433a-b05f-6f577206cdff service nova] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 797.250412] env[71140]: INFO networking_nsxv3.common.synchronization [req-657ca5f2-01f5-4592-8dbe-9c507c86c848 req-e819ef9b-d05f-433a-b05f-6f577206cdff service nova] Enqueued Resource ID: 5cee26b7-18e1-4185-968f-6579953fa936 with Priority: HIGHEST for action port [ 797.252147] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_rules [ 797.252242] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 797.252371] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cee26b7-18e1-4185-968f-6579953fa936 with Priority: HIGHEST for action port [ 797.252722] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.252877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.253200] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.253303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.257059] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cee26b7-18e1-4185-968f-6579953fa936 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.257059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cee26b7-18e1-4185-968f-6579953fa936" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.257059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cee26b7-18e1-4185-968f-6579953fa936" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.257059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cee26b7-18e1-4185-968f-6579953fa936" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.257059] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cee26b7-18e1-4185-968f-6579953fa936',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.290162] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.290162] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.290162] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.290162] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.290327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.290327] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0021f162-837d-4356-afbf-4e10e33828d6 is going to be updated. [ 797.318235] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.318405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.318486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.322074] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.322074] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.329187] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0021f162-837d-4356-afbf-4e10e33828d6 in Status: IN_PROGRESS for 2s [ 797.382467] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b10adf43-641a-4919-9beb-96c8450b7197 [ 797.382746] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.382923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.382994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.383479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.383636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.383746] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b10adf43-641a-4919-9beb-96c8450b7197 already deleted. [ 797.383837] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b10adf43-641a-4919-9beb-96c8450b7197" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.547463] env[71140]: INFO networking_nsxv3.common.synchronization [req-6764f06d-37c2-472b-86a8-be8b28bc6fce req-4a80390b-ad81-451b-ac67-9c6c704bfff5 tempest-SecurityGroupRulesTestJSON-839819543 tempest-SecurityGroupRulesTestJSON-839819543-project-member] Enqueued Resource ID: 58778137-8464-4071-9d19-74d1cf79767d with Priority: HIGHEST for action security_group_rules [ 797.548207] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58778137-8464-4071-9d19-74d1cf79767d with Priority: HIGHEST for action security_group_rules [ 797.551812] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58778137-8464-4071-9d19-74d1cf79767d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.551812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58778137-8464-4071-9d19-74d1cf79767d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.551812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58778137-8464-4071-9d19-74d1cf79767d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.551812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58778137-8464-4071-9d19-74d1cf79767d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.551812] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58778137-8464-4071-9d19-74d1cf79767d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.561064] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: SUCCESS [ 797.561064] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.561064] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.561526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.561715] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.561836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.561901] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.562061] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.562366] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.562521] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e12e6f08-d99f-4fd3-9323-d04895bd2256',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.606016] env[71140]: INFO networking_nsxv3.common.synchronization [req-7fcf4783-55bb-439d-abca-83779dd7f28b req-2977fde9-bf53-4536-afa7-bcc2c0a6acd4 service nova] Enqueued Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGHEST for action security_group_rules [ 797.606016] env[71140]: INFO networking_nsxv3.common.synchronization [req-7fcf4783-55bb-439d-abca-83779dd7f28b req-2977fde9-bf53-4536-afa7-bcc2c0a6acd4 service nova] Enqueued Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGHEST for action security_group_members [ 797.606016] env[71140]: INFO networking_nsxv3.common.synchronization [req-7fcf4783-55bb-439d-abca-83779dd7f28b req-2977fde9-bf53-4536-afa7-bcc2c0a6acd4 service nova] Enqueued Resource ID: 2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa with Priority: HIGHEST for action port [ 797.606016] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGHEST for action security_group_rules [ 797.606016] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGHEST for action security_group_members [ 797.606016] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa with Priority: HIGHEST for action port [ 797.606696] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.606824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.606893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.607148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.607233] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.608237] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.608344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.608826] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.608939] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.609020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.609217] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.609295] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.712166] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.713338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.713338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.715681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.715681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.715681] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a is going to be updated. [ 797.718843] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.718843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.718843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.718843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.718843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.718843] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 797.745027] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.745027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.745027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.745027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.745027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.745611] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.745894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.746123] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.746431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.746749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.759294] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 797.759294] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a in Status: IN_PROGRESS for 2s [ 797.759294] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cee26b7-18e1-4185-968f-6579953fa936 with status ACTIVE [ 797.759294] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.759294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.759294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.759294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.759294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.759294] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.759294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.759294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.759294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.759294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.759294] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.759294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.759816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.759816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.759816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.759816] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cee26b7-18e1-4185-968f-6579953fa936 is going to be updated. [ 797.779552] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.779552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.779552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.779552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.779552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.779552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cee26b7-18e1-4185-968f-6579953fa936" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.068570] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.068570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.068570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.068570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.068570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.068570] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.068570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.068570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.068570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.068570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.068570] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 is going to be updated. [ 798.072965] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.072965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.072965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.072965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.072965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.072965] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58778137-8464-4071-9d19-74d1cf79767d already deleted. [ 798.072965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58778137-8464-4071-9d19-74d1cf79767d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.094028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.094028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.094028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.094028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.094028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.101908] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: IN_PROGRESS for 2s [ 798.114022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.114022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.114022] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa with status ACTIVE [ 798.114022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.114022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.114022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.114022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.114022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.114022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.114022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.114022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.114022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.114022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.114739] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.114739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.114739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.114739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.114739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.114739] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa is going to be updated. [ 798.133405] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.133405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.133405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.133405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.133405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.133405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ec1259f-eb13-44fe-a6e7-c8c311f7a8aa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.225158] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-355 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.225550] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-355" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.225974] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-355" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.229587] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-355" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.229587] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.229587] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.229587] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.229587] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.229587] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.229587] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.229587] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.229587] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.229587] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.229587] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.229587] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.229587] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.247372] env[71140]: INFO networking_nsxv3.common.synchronization [req-f1da7181-fc06-434d-8c4c-79c3ad2a7150 req-fe0474ec-1455-4965-a617-398f342035e6 tempest-ServerDiskConfigTestJSON-63292790 tempest-ServerDiskConfigTestJSON-63292790-project-member] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 798.251017] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 798.251017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.251017] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 798.251017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.251017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.251017] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.251017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.251017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.251017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.251017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.251017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.251017] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.252330] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.252491] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 798.252701] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.252886] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-355" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.253733] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-4eb84278-2390-4e95-9028-e876ae8cb465 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.253943] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-4eb84278-2390-4e95-9028-e876ae8cb465" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.254102] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-4eb84278-2390-4e95-9028-e876ae8cb465" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.254412] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-4eb84278-2390-4e95-9028-e876ae8cb465" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.254557] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb84278-2390-4e95-9028-e876ae8cb465',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.255476] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.255580] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.255635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.255796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.257178] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.257178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.257178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.257178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.257178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.257178] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.257178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.257466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.257466] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.259997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.259997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.259997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.259997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.259997] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.574900] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.575125] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.575255] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.575532] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.575792] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.575950] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.576084] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.576302] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.576449] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.576665] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.576797] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.576913] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.577030] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.577142] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.577247] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.577378] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.595033] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.595182] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 798.595369] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.595496] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.595821] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-08200f84-e2c8-4a37-9843-6fd922800d6f taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.596019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-08200f84-e2c8-4a37-9843-6fd922800d6f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.596128] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-08200f84-e2c8-4a37-9843-6fd922800d6f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.596474] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-08200f84-e2c8-4a37-9843-6fd922800d6f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.596622] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08200f84-e2c8-4a37-9843-6fd922800d6f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.752389] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.752743] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.761349] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.761598] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.761727] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.762020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.762212] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.762368] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 4eb84278-2390-4e95-9028-e876ae8cb465 not found, creating... [ 798.762645] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.762824] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.763012] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.763277] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.763422] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.763742] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.763907] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.764109] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.764417] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.764595] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.764748] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 4eb84278-2390-4e95-9028-e876ae8cb465 is going to be created. [ 798.766162] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.766286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.766357] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.766520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.766621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.766856] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.766931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.766992] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.767167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.767246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.767350] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 798.768781] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.786198] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.786444] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.786584] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.786898] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.787165] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.787436] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-4eb84278-2390-4e95-9028-e876ae8cb465" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.790753] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.790889] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.790964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.791172] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.791304] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.800021] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 799.099234] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.099234] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.099234] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.099499] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.099499] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.099664] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 08200f84-e2c8-4a37-9843-6fd922800d6f not found, creating... [ 799.099907] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.100076] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.100194] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.100413] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.100579] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.102778] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.102778] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.102778] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.102778] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.102778] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.102778] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 08200f84-e2c8-4a37-9843-6fd922800d6f is going to be created. [ 799.126016] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.126016] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.126016] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.126016] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.126016] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.126016] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-08200f84-e2c8-4a37-9843-6fd922800d6f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.271355] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.338960] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0021f162-837d-4356-afbf-4e10e33828d6 in Status: SUCCESS [ 799.339268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.339386] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.339668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.339909] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.340071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.340205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.340371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.340508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.340615] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.633551] env[71140]: INFO networking_nsxv3.common.synchronization [req-657ca5f2-01f5-4592-8dbe-9c507c86c848 req-2a010adc-becc-4b07-89d1-cb06ae94ae8c service nova] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_rules [ 799.633735] env[71140]: INFO networking_nsxv3.common.synchronization [req-657ca5f2-01f5-4592-8dbe-9c507c86c848 req-2a010adc-becc-4b07-89d1-cb06ae94ae8c service nova] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 799.634519] env[71140]: INFO networking_nsxv3.common.synchronization [req-657ca5f2-01f5-4592-8dbe-9c507c86c848 req-2a010adc-becc-4b07-89d1-cb06ae94ae8c service nova] Enqueued Resource ID: 4eb84278-2390-4e95-9028-e876ae8cb465 with Priority: HIGHEST for action port [ 799.634519] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_rules [ 799.634519] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 799.634519] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb84278-2390-4e95-9028-e876ae8cb465 with Priority: HIGHEST for action port [ 799.635654] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.635795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.636048] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.636178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.636382] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eb84278-2390-4e95-9028-e876ae8cb465 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.636524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eb84278-2390-4e95-9028-e876ae8cb465" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.636580] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eb84278-2390-4e95-9028-e876ae8cb465" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.636908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eb84278-2390-4e95-9028-e876ae8cb465" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.636988] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb84278-2390-4e95-9028-e876ae8cb465',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.766332] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 799.766748] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.767375] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a in Status: SUCCESS [ 799.767554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.768099] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.768099] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.768657] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.768831] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.768922] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.769117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.769337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.769443] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.769648] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.769785] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.769901] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.769951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.770137] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.770238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.770426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.770569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.770632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.770714] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.770823] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.776019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.776019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.776019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.776019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.776019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.776019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.776019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.776019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.776019] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.776755] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.776755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.776755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.776755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.776884] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.776884] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be updated. [ 799.778945] env[71140]: INFO networking_nsxv3.common.synchronization [req-d331fe71-882c-443e-a8ed-e2978eea12a6 req-45cbef18-ec9f-4aa5-939a-88265ba03902 tempest-SecurityGroupRulesTestJSON-839819543 tempest-SecurityGroupRulesTestJSON-839819543-project-member] Enqueued Resource ID: 2a9a7e84-e08b-4f18-ae83-aaffaf1184e5 with Priority: HIGHEST for action security_group_rules [ 799.779479] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a9a7e84-e08b-4f18-ae83-aaffaf1184e5 with Priority: HIGHEST for action security_group_rules [ 799.780193] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a9a7e84-e08b-4f18-ae83-aaffaf1184e5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.780314] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a9a7e84-e08b-4f18-ae83-aaffaf1184e5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.780383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a9a7e84-e08b-4f18-ae83-aaffaf1184e5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.780623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a9a7e84-e08b-4f18-ae83-aaffaf1184e5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.780722] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a9a7e84-e08b-4f18-ae83-aaffaf1184e5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.804423] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.804423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.804423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.805844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.805844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.813468] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: IN_PROGRESS for 2s [ 799.843949] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.885729] env[71140]: INFO networking_nsxv3.common.synchronization [req-f1da7181-fc06-434d-8c4c-79c3ad2a7150 req-e41cfda9-c6e2-4b5e-a71f-cf57afca6a52 service nova] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_rules [ 799.885901] env[71140]: INFO networking_nsxv3.common.synchronization [req-f1da7181-fc06-434d-8c4c-79c3ad2a7150 req-e41cfda9-c6e2-4b5e-a71f-cf57afca6a52 service nova] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 799.886086] env[71140]: INFO networking_nsxv3.common.synchronization [req-f1da7181-fc06-434d-8c4c-79c3ad2a7150 req-e41cfda9-c6e2-4b5e-a71f-cf57afca6a52 service nova] Enqueued Resource ID: 08200f84-e2c8-4a37-9843-6fd922800d6f with Priority: HIGHEST for action port [ 799.886647] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_rules [ 799.886900] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 799.887431] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08200f84-e2c8-4a37-9843-6fd922800d6f with Priority: HIGHEST for action port [ 799.887837] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.888015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.888131] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.888434] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.889123] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.890317] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.890619] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.893442] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-08200f84-e2c8-4a37-9843-6fd922800d6f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.893671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08200f84-e2c8-4a37-9843-6fd922800d6f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.893671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08200f84-e2c8-4a37-9843-6fd922800d6f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.893883] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08200f84-e2c8-4a37-9843-6fd922800d6f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.893971] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08200f84-e2c8-4a37-9843-6fd922800d6f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.110665] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: IN_PROGRESS for 4s [ 800.145654] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4eb84278-2390-4e95-9028-e876ae8cb465 with status ACTIVE [ 800.145878] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.146051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.146170] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.146451] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.146600] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.146885] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.147072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.147072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.147219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.147316] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.147482] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.147569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.147632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.147770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.147845] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.147928] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4eb84278-2390-4e95-9028-e876ae8cb465 is going to be updated. [ 800.169473] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.169656] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.169900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.170225] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.170395] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.170587] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eb84278-2390-4e95-9028-e876ae8cb465" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.273974] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470: rpc.has_security_group_logging(os_id): False [ 800.286264] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.296929] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.296929] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.296929] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.296929] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.296929] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.296929] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.297479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.297479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.297479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.297479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.297616] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.297616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.297713] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.297887] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.297950] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.298108] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.298198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.298267] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.298418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.298494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.298608] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 800.311245] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.311410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.311410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.311633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.311719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.311814] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a9a7e84-e08b-4f18-ae83-aaffaf1184e5 already deleted. [ 800.311897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a9a7e84-e08b-4f18-ae83-aaffaf1184e5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.346648] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.358566] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.358843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.358917] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.359201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.359370] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.372673] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 800.398490] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08200f84-e2c8-4a37-9843-6fd922800d6f with status ACTIVE [ 800.398490] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.398490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.398490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.398490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.398490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.398490] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.398490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.398490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.398490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.398490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.398839] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.398839] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.398839] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.399195] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.399195] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.399195] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08200f84-e2c8-4a37-9843-6fd922800d6f is going to be updated. [ 800.401167] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.401360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.424055] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.424055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.424055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.424364] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.424364] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.425048] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08200f84-e2c8-4a37-9843-6fd922800d6f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.788282] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30d81b57-1e7d-4b6c-8223-18f586dd832a: rpc.has_security_group_logging(os_id): False [ 800.806392] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.806582] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.806621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.807038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.807150] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.807399] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.807514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.807613] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.807779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.807856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.807947] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a is going to be updated. [ 800.811378] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 800.811648] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 deletion is rescheduled due to dependency. [ 800.811804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.812455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.812840] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.813098] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.813269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.813375] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.813574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.813705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.813842] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.853631] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.853823] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.853900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.854152] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.854249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.854351] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0021f162-837d-4356-afbf-4e10e33828d6 is going to be updated. [ 800.860830] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.860978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.861063] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.861279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.861431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.873102] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a in Status: IN_PROGRESS for 2s [ 800.890431] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.890640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.890692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.890929] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.891123] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.920446] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0021f162-837d-4356-afbf-4e10e33828d6 in Status: IN_PROGRESS for 2s [ 801.184679] env[71140]: INFO networking_nsxv3.common.synchronization [req-5db3b65e-e237-4d87-a1d6-b14ee1ee3447 req-f1982990-62ab-4ee1-a867-e1ca5c8d98e4 tempest-ImagesTestJSON-1376189349 tempest-ImagesTestJSON-1376189349-project-member] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 801.185444] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 801.185843] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.186170] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.186170] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.186411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.186611] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.186786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.186893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.187125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.187264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.187459] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.317160] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.690965] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.691260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.691380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.691648] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.691796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.692068] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.692242] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.692348] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.692550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.692676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.692807] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be updated. [ 801.721335] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.722608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.722724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.722951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.723108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.731697] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 801.820516] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.822926] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 801.823091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.823211] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.823421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.823641] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.823781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.823837] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.823972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.824058] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.824151] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.824309] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.824379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.824438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.824682] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.824765] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.824867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.824931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.825088] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.825158] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.825240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.825325] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.826060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.826226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.826369] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.826463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.826762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.826762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.826862] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.826862] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.976275] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-920 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.976468] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.976648] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.977099] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.977212] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.977416] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.977558] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.978590] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.978722] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.978953] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.979024] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.979131] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.979391] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.979557] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.979674] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.979814] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.998548] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.998718] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 801.998857] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.999096] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.999423] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-71d34ef4-9292-41da-9bac-eb2e7b609e18 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.999598] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-71d34ef4-9292-41da-9bac-eb2e7b609e18" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.999722] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-71d34ef4-9292-41da-9bac-eb2e7b609e18" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.001455] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-71d34ef4-9292-41da-9bac-eb2e7b609e18" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.001455] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71d34ef4-9292-41da-9bac-eb2e7b609e18',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.123398] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 in Status: SUCCESS [ 802.123585] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12e6f08-d99f-4fd3-9323-d04895bd2256 deletion is rescheduled due to dependency. [ 802.123673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12e6f08-d99f-4fd3-9323-d04895bd2256" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.322096] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.322301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.322344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.322516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.322603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.323379] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 802.328661] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e: rpc.has_security_group_logging(os_id): False [ 802.330569] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.352517] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.352517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.352517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.352517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.352517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.352517] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.352517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.352517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.352517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.352517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.352517] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.352517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.352517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.353168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.353168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.353168] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.353168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.353168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.353168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.353387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.353387] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be created. [ 802.375179] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.375179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.375179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.375179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.375179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.384108] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 802.389891] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 802.390296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.390668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.390995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.391267] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.430145] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.430421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.430421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.431142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.431142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.447907] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: IN_PROGRESS for 2s [ 802.504791] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.508022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.508022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.508022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.508022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.508022] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 71d34ef4-9292-41da-9bac-eb2e7b609e18 not found, creating... [ 802.508022] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.508022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.508022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.508022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.508022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.508583] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.508583] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.509216] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.510597] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.510597] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.510597] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 71d34ef4-9292-41da-9bac-eb2e7b609e18 is going to be created. [ 802.538267] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.538477] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.538600] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.538886] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.539126] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.539350] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-71d34ef4-9292-41da-9bac-eb2e7b609e18" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.832842] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.891252] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a in Status: SUCCESS [ 802.891252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.893793] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.893793] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.893793] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.894054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.895298] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.895298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.895298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.895298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.895298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.895298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.895298] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.932307] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0021f162-837d-4356-afbf-4e10e33828d6 in Status: SUCCESS [ 802.932527] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.933039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.933264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.933486] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.933716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.933716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.933786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.933972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.933972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.934095] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.337846] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.338085] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.338135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.338319] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.338424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.338527] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be updated. [ 803.364166] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.364316] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.364382] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.364640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.364806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.398579] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.398751] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.398751] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.398967] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.399154] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.399263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.399325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.399964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.400136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.400259] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.400442] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.400568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.400652] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.400826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.400993] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.401144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.401322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.401499] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.401604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.401721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.401833] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.438978] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.438978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.438978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.438978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.438978] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.438978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.438978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.438978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.438978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.438978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.438978] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.438978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.438978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.439632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.439632] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.439632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.439632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.439632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.439632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.439829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.439829] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.494455] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: IN_PROGRESS for 2s [ 803.559436] env[71140]: INFO networking_nsxv3.common.synchronization [req-b4c59479-380a-408a-9b1e-b50994a4a8b6 req-56f6bee6-9aa5-4ba9-9137-5e35d9292ffc tempest-AttachVolumeNegativeTest-950002537 tempest-AttachVolumeNegativeTest-950002537-project-member] Enqueued Resource ID: 6f6ea965-586b-4847-a20f-3619378cb260 with Priority: HIGHEST for action security_group_members [ 803.559977] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6ea965-586b-4847-a20f-3619378cb260 with Priority: HIGHEST for action security_group_members [ 803.560298] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6ea965-586b-4847-a20f-3619378cb260 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.560418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.560484] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.560726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.560885] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.560986] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.563505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.563726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.563822] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.563922] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f6ea965-586b-4847-a20f-3619378cb260',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.670870] env[71140]: INFO networking_nsxv3.common.synchronization [req-5db3b65e-e237-4d87-a1d6-b14ee1ee3447 req-c9256736-86e9-4955-8878-94fa0cbf6a1a service nova] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_rules [ 803.671046] env[71140]: INFO networking_nsxv3.common.synchronization [req-5db3b65e-e237-4d87-a1d6-b14ee1ee3447 req-c9256736-86e9-4955-8878-94fa0cbf6a1a service nova] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 803.671181] env[71140]: INFO networking_nsxv3.common.synchronization [req-5db3b65e-e237-4d87-a1d6-b14ee1ee3447 req-c9256736-86e9-4955-8878-94fa0cbf6a1a service nova] Enqueued Resource ID: 71d34ef4-9292-41da-9bac-eb2e7b609e18 with Priority: HIGHEST for action port [ 803.671435] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_rules [ 803.671573] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 803.671668] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d34ef4-9292-41da-9bac-eb2e7b609e18 with Priority: HIGHEST for action port [ 803.675296] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.675420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.675486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.675683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.675760] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.676619] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.676741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.677816] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-71d34ef4-9292-41da-9bac-eb2e7b609e18 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.677816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71d34ef4-9292-41da-9bac-eb2e7b609e18" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.677816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71d34ef4-9292-41da-9bac-eb2e7b609e18" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.677816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71d34ef4-9292-41da-9bac-eb2e7b609e18" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.677816] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71d34ef4-9292-41da-9bac-eb2e7b609e18',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.740727] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 803.740915] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 deletion is rescheduled due to dependency. [ 803.741045] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.741556] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.741773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.741977] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.742112] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.742176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.742342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.742421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.742515] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.902077] env[71140]: INFO networking_nsxv3.common.synchronization [req-67f76976-b368-4c39-97fe-0de0d94ebf2d req-e05d7c83-58ec-4806-9a7a-a10823d07fa7 tempest-SecurityGroupRulesTestJSON-839819543 tempest-SecurityGroupRulesTestJSON-839819543-project-member] Enqueued Resource ID: 9ba11120-bdf8-4f35-9f5f-97ae9341d361 with Priority: HIGHEST for action security_group_rules [ 803.902077] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba11120-bdf8-4f35-9f5f-97ae9341d361 with Priority: HIGHEST for action security_group_rules [ 803.902932] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ba11120-bdf8-4f35-9f5f-97ae9341d361 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.903068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ba11120-bdf8-4f35-9f5f-97ae9341d361" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.903135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ba11120-bdf8-4f35-9f5f-97ae9341d361" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.903388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ba11120-bdf8-4f35-9f5f-97ae9341d361" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.903474] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ba11120-bdf8-4f35-9f5f-97ae9341d361',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.904856] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470: rpc.has_security_group_logging(os_id): False [ 803.924616] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.924880] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.924949] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.925176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.925270] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.925555] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.925635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.925635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.925785] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.925864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.926092] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.926186] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.926236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.926382] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.926461] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.926635] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.926783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.926852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.926987] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.927918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.928044] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 803.943449] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0021f162-837d-4356-afbf-4e10e33828d6: rpc.has_security_group_logging(os_id): False [ 803.957658] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.957899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.958061] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.958377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.958494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.958753] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.958855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.958916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.959091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.959166] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.959346] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.959432] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.959490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.959626] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.959713] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.959898] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.959986] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.960339] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.960507] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.960738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.960822] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0021f162-837d-4356-afbf-4e10e33828d6 is going to be updated. [ 803.993904] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.994106] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.994106] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.994316] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.994483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.007849] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 804.015994] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.016176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.016217] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.016417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.016587] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.033848] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0021f162-837d-4356-afbf-4e10e33828d6 in Status: IN_PROGRESS for 2s [ 804.066100] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.066273] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.066326] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.066532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.066624] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.066903] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.067043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.067110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.067297] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.067348] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.067964] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f6ea965-586b-4847-a20f-3619378cb260 already deleted. [ 804.068118] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.181687] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.181885] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.182036] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71d34ef4-9292-41da-9bac-eb2e7b609e18 with status ACTIVE [ 804.182216] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.182324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.182389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.182618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.182708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.182891] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.183008] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.183076] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.183224] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.183300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.183478] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.183568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.183628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.183769] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.183834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.183917] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71d34ef4-9292-41da-9bac-eb2e7b609e18 is going to be updated. [ 804.214116] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.214773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.214773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.214773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.215132] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.215203] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71d34ef4-9292-41da-9bac-eb2e7b609e18" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.246107] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.252717] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-838 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.252717] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-838" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.252861] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-838" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.253123] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-838" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.253391] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.253549] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.253669] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.253884] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.254209] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.254446] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 804.254576] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.254688] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.254797] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.254905] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 804.255014] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.255165] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.275564] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.275725] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 804.275876] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.276071] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-838" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.276383] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-2147d0bd-1ba3-47bd-b805-d9aa16b7ce67 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.276555] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-2147d0bd-1ba3-47bd-b805-d9aa16b7ce67" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.276724] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-2147d0bd-1ba3-47bd-b805-d9aa16b7ce67" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.277833] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-2147d0bd-1ba3-47bd-b805-d9aa16b7ce67" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.278124] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2147d0bd-1ba3-47bd-b805-d9aa16b7ce67',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.396120] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 804.396344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.396514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.396754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.396957] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.397093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.397151] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.397318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.397401] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.397486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.397578] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.427362] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.427535] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.427605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.427872] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.427978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.428092] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ba11120-bdf8-4f35-9f5f-97ae9341d361 already deleted. [ 804.428182] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ba11120-bdf8-4f35-9f5f-97ae9341d361" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.461557] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 804.461859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.462539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.462846] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.462924] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.747732] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.784473] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.784473] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.784473] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.784473] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.784698] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.784749] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 2147d0bd-1ba3-47bd-b805-d9aa16b7ce67 not found, creating... [ 804.785076] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.785249] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.785369] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.785624] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.786953] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.786953] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.786953] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.786953] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.786953] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.786953] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.786953] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 2147d0bd-1ba3-47bd-b805-d9aa16b7ce67 is going to be created. [ 804.810516] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.810516] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.810516] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.810516] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.810516] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.810516] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-2147d0bd-1ba3-47bd-b805-d9aa16b7ce67" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.901256] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.901430] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.901546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.901789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.901972] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.902093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.902322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.902322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.902393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.902481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.902628] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.902723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.902785] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.902928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.903083] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.903175] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.903291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.903441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.903545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.903703] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.903703] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.965344] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.965530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.253893] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.253893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.253893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.254087] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.254087] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.254227] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be updated. [ 805.281344] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.281344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.281344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.281344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.281344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.289949] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 805.408301] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2975c43-5d19-4643-8076-5d24f0ea84c6: rpc.has_security_group_logging(os_id): False [ 805.429712] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.430376] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.430544] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.430902] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.431166] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.431560] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.432144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.432221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.432409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.432502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.432737] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.432851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.432908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.433652] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.433868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.434239] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.434558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.434626] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.434925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.435083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.435318] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 805.489544] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.489721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.490262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.490262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.490262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.502881] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 805.503738] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 805.504066] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.504256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.504642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.504775] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.504890] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.505099] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.505279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.505367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.505462] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.505564] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.668332] env[71140]: INFO networking_nsxv3.common.synchronization [req-b4c59479-380a-408a-9b1e-b50994a4a8b6 req-7cfa321f-e659-4ceb-b980-d80941888ea6 service nova] Enqueued Resource ID: 6f6ea965-586b-4847-a20f-3619378cb260 with Priority: HIGHEST for action security_group_rules [ 805.670031] env[71140]: INFO networking_nsxv3.common.synchronization [req-b4c59479-380a-408a-9b1e-b50994a4a8b6 req-7cfa321f-e659-4ceb-b980-d80941888ea6 service nova] Enqueued Resource ID: 6f6ea965-586b-4847-a20f-3619378cb260 with Priority: HIGHEST for action security_group_members [ 805.670031] env[71140]: INFO networking_nsxv3.common.synchronization [req-b4c59479-380a-408a-9b1e-b50994a4a8b6 req-7cfa321f-e659-4ceb-b980-d80941888ea6 service nova] Enqueued Resource ID: 2147d0bd-1ba3-47bd-b805-d9aa16b7ce67 with Priority: HIGHEST for action port [ 805.670031] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6ea965-586b-4847-a20f-3619378cb260 with Priority: HIGHEST for action security_group_rules [ 805.670031] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6ea965-586b-4847-a20f-3619378cb260 with Priority: HIGHEST for action security_group_members [ 805.670031] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2147d0bd-1ba3-47bd-b805-d9aa16b7ce67 with Priority: HIGHEST for action port [ 805.670031] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f6ea965-586b-4847-a20f-3619378cb260 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.674174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.674174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.674174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.674174] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f6ea965-586b-4847-a20f-3619378cb260',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.675416] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6ea965-586b-4847-a20f-3619378cb260 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.675416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.675416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.675585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.675789] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.675910] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.675974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.676179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.676285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.676407] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f6ea965-586b-4847-a20f-3619378cb260',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.678412] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-2147d0bd-1ba3-47bd-b805-d9aa16b7ce67 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.678700] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2147d0bd-1ba3-47bd-b805-d9aa16b7ce67" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.678839] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2147d0bd-1ba3-47bd-b805-d9aa16b7ce67" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.679100] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2147d0bd-1ba3-47bd-b805-d9aa16b7ce67" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.679356] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2147d0bd-1ba3-47bd-b805-d9aa16b7ce67',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.011826] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.011826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.011826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.011826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.011826] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.011826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.011826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.011826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.011826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.011826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.011826] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.011826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.011826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.011826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.012655] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.012655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.012655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.012655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.012655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.012655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.012655] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.029281] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 806.029281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.045633] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0021f162-837d-4356-afbf-4e10e33828d6 in Status: SUCCESS [ 806.045633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.181571] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6ea965-586b-4847-a20f-3619378cb260 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.181571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.188022] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f6ea965-586b-4847-a20f-3619378cb260',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.188022] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2147d0bd-1ba3-47bd-b805-d9aa16b7ce67 with status ACTIVE [ 806.188022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.188022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.188022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.188022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.188022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.188022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.188022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.188022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.188022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.188022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.188022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.188022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.188022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.188581] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.188581] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.188581] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2147d0bd-1ba3-47bd-b805-d9aa16b7ce67 is going to be updated. [ 806.219511] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.219511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.219511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.219511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.219511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.219511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2147d0bd-1ba3-47bd-b805-d9aa16b7ce67" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.515668] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e: rpc.has_security_group_logging(os_id): False [ 806.537317] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.537466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.538126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.538126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.538126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.538300] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.538300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.538387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.540687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.540687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.540687] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.540687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.540687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.540687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.540687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.540687] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.540687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.540687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.540687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.540687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.540687] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be updated. [ 806.595739] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.595739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.595739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.595739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.595739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.603887] env[71140]: INFO networking_nsxv3.common.synchronization [req-98a4ad31-1c80-4e3b-937f-a3a2ee42bd39 req-b39af50b-46d1-47b8-b93b-21292b595dca tempest-SecurityGroupRulesTestJSON-839819543 tempest-SecurityGroupRulesTestJSON-839819543-project-member] Enqueued Resource ID: 530243d9-d0f6-46b6-9c3b-b08c883a1195 with Priority: HIGHEST for action security_group_rules [ 806.603887] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530243d9-d0f6-46b6-9c3b-b08c883a1195 with Priority: HIGHEST for action security_group_rules [ 806.603887] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-530243d9-d0f6-46b6-9c3b-b08c883a1195 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.603887] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-530243d9-d0f6-46b6-9c3b-b08c883a1195" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.603887] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-530243d9-d0f6-46b6-9c3b-b08c883a1195" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.604387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-530243d9-d0f6-46b6-9c3b-b08c883a1195" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.604387] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('530243d9-d0f6-46b6-9c3b-b08c883a1195',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.608271] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: IN_PROGRESS for 2s [ 806.693264] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f6ea965-586b-4847-a20f-3619378cb260',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.127318] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.127620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.127620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.127844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.127944] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.127981] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 530243d9-d0f6-46b6-9c3b-b08c883a1195 already deleted. [ 807.128087] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-530243d9-d0f6-46b6-9c3b-b08c883a1195" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.203615] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.203763] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.203913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.204646] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.204646] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.204646] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f6ea965-586b-4847-a20f-3619378cb260 is going to be created. [ 807.230017] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.230199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.230277] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.230483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.230689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.239502] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6ea965-586b-4847-a20f-3619378cb260 in Status: UNINITIALIZED for 2s [ 807.261906] env[71140]: INFO networking_nsxv3.common.synchronization [req-67d320f8-a895-4bdf-9936-4f26dd94c64f req-28b449d6-74dc-4c0c-b9a1-2d45d9e92d41 tempest-ServerTagsTestJSON-420786443 tempest-ServerTagsTestJSON-420786443-project-member] Enqueued Resource ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 with Priority: HIGHEST for action security_group_members [ 807.263090] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 with Priority: HIGHEST for action security_group_members [ 807.263439] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea05fd0-2f31-49b2-a904-3b840403e3a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.263562] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.263628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.263916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.264528] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.264740] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.264740] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.265870] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.266492] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.266647] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dea05fd0-2f31-49b2-a904-3b840403e3a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.298920] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 807.299196] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.299651] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.299872] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.300075] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.300192] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.300258] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.300416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.300501] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.300587] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.300848] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.515089] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 807.515342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.553783] env[71140]: INFO networking_nsxv3.common.synchronization [req-9da46fe3-08d4-404b-9709-543a52240415 req-6bb60b58-eae2-4242-b8fe-0047d51dd887 tempest-SecurityGroupRulesTestJSON-839819543 tempest-SecurityGroupRulesTestJSON-839819543-project-member] Enqueued Resource ID: 08a2d7a6-e12b-44c5-b754-7f25b6763d29 with Priority: HIGHEST for action security_group_rules [ 807.554458] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08a2d7a6-e12b-44c5-b754-7f25b6763d29 with Priority: HIGHEST for action security_group_rules [ 807.554789] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08a2d7a6-e12b-44c5-b754-7f25b6763d29 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.554906] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08a2d7a6-e12b-44c5-b754-7f25b6763d29" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.555256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08a2d7a6-e12b-44c5-b754-7f25b6763d29" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.555256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08a2d7a6-e12b-44c5-b754-7f25b6763d29" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.555374] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08a2d7a6-e12b-44c5-b754-7f25b6763d29',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.647688] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-980 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.647890] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-980" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.648059] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-980" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.648924] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-980" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.648924] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.649134] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.649338] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.649635] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.649852] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.650124] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.650264] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.650382] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.650519] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.650645] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.650772] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.650959] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.671445] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.671630] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 807.671788] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.671992] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-980" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.672711] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-33c8c733-53c0-479b-9e64-0ae9cff1647d taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.672711] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-33c8c733-53c0-479b-9e64-0ae9cff1647d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.672711] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-33c8c733-53c0-479b-9e64-0ae9cff1647d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.673148] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-33c8c733-53c0-479b-9e64-0ae9cff1647d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.673148] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33c8c733-53c0-479b-9e64-0ae9cff1647d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.772881] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.773198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.773300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.773627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.773771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.774124] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.774322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.774429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.774712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.774845] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.774973] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 already deleted. [ 807.775129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.805536] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.805746] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.805882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.806260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.806545] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.806744] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.806873] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.807155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.807308] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.807554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.807669] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.807761] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.807881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.811170] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.811381] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.811477] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.811608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.811728] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.811824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.811905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.811992] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.081441] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.081744] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.081897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.082221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.082369] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.082552] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08a2d7a6-e12b-44c5-b754-7f25b6763d29 already deleted. [ 808.082679] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08a2d7a6-e12b-44c5-b754-7f25b6763d29" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.091983] env[71140]: INFO networking_nsxv3.common.synchronization [req-240db56a-6584-417c-8089-85de129ad584 req-7688c8f8-54c3-4057-9a47-48cba7818fe5 tempest-SecurityGroupRulesTestJSON-839819543 tempest-SecurityGroupRulesTestJSON-839819543-project-member] Enqueued Resource ID: 08a2d7a6-e12b-44c5-b754-7f25b6763d29 with Priority: HIGHEST for action security_group_rules [ 808.092724] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08a2d7a6-e12b-44c5-b754-7f25b6763d29 with Priority: HIGHEST for action security_group_rules [ 808.093133] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08a2d7a6-e12b-44c5-b754-7f25b6763d29 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.093342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08a2d7a6-e12b-44c5-b754-7f25b6763d29" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.093342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08a2d7a6-e12b-44c5-b754-7f25b6763d29" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.093542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08a2d7a6-e12b-44c5-b754-7f25b6763d29" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.093629] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08a2d7a6-e12b-44c5-b754-7f25b6763d29',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.178876] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.182027] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.182027] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.182027] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.182027] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.182027] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 33c8c733-53c0-479b-9e64-0ae9cff1647d not found, creating... [ 808.182027] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.182027] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.182027] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.182565] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.182819] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.183301] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.183740] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.183990] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.184459] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.184726] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.184985] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 33c8c733-53c0-479b-9e64-0ae9cff1647d is going to be created. [ 808.209632] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.212709] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.212709] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.212709] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.212709] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.212709] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-33c8c733-53c0-479b-9e64-0ae9cff1647d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.314469] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43a772d0-e00d-4627-ad2d-c6c3ccbcee06: rpc.has_security_group_logging(os_id): False [ 808.334199] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.334199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.334199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.334199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.334199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.334199] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.334199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.334199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.334199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.334199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.334199] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.334199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.334199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.334730] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.334730] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.335026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.335242] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.335388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.335605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.335764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.335933] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be updated. [ 808.393693] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.393693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.393693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.393693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.393693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.405728] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 808.621198] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.621198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.621198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.621198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.621198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.621198] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08a2d7a6-e12b-44c5-b754-7f25b6763d29 already deleted. [ 808.621198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08a2d7a6-e12b-44c5-b754-7f25b6763d29" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.625218] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 808.625218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.626599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.626904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.627718] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.639272] env[71140]: INFO networking_nsxv3.common.synchronization [req-c45c7c41-74f8-4c2e-98f3-f73beaac01d2 req-1113f868-03aa-49b8-a3ca-3d7e837bddc7 tempest-SecurityGroupRulesTestJSON-839819543 tempest-SecurityGroupRulesTestJSON-839819543-project-member] Enqueued Resource ID: 08a2d7a6-e12b-44c5-b754-7f25b6763d29 with Priority: HIGHEST for action security_group_rules [ 808.639272] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08a2d7a6-e12b-44c5-b754-7f25b6763d29 with Priority: HIGHEST for action security_group_rules [ 808.639272] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08a2d7a6-e12b-44c5-b754-7f25b6763d29 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.639272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08a2d7a6-e12b-44c5-b754-7f25b6763d29" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.639272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08a2d7a6-e12b-44c5-b754-7f25b6763d29" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.639272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08a2d7a6-e12b-44c5-b754-7f25b6763d29" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.639272] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08a2d7a6-e12b-44c5-b754-7f25b6763d29',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.128784] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.129410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.129410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.129547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.129720] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.129902] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.129963] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.130112] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.130210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.130303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.130397] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.160403] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.160632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.160728] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.160968] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.161627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.161627] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08a2d7a6-e12b-44c5-b754-7f25b6763d29 already deleted. [ 809.161627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08a2d7a6-e12b-44c5-b754-7f25b6763d29" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.249385] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6ea965-586b-4847-a20f-3619378cb260 in Status: SUCCESS [ 809.249687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.249763] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.249984] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.250185] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.250301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.250367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.250515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.250599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.250683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.250773] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f6ea965-586b-4847-a20f-3619378cb260',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.262292] env[71140]: INFO networking_nsxv3.common.synchronization [req-67d320f8-a895-4bdf-9936-4f26dd94c64f req-582a9383-e9a5-4cc3-a976-b8348e26fc6c service nova] Enqueued Resource ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 with Priority: HIGHEST for action security_group_rules [ 809.262464] env[71140]: INFO networking_nsxv3.common.synchronization [req-67d320f8-a895-4bdf-9936-4f26dd94c64f req-582a9383-e9a5-4cc3-a976-b8348e26fc6c service nova] Enqueued Resource ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 with Priority: HIGHEST for action security_group_members [ 809.262602] env[71140]: INFO networking_nsxv3.common.synchronization [req-67d320f8-a895-4bdf-9936-4f26dd94c64f req-582a9383-e9a5-4cc3-a976-b8348e26fc6c service nova] Enqueued Resource ID: 33c8c733-53c0-479b-9e64-0ae9cff1647d with Priority: HIGHEST for action port [ 809.263118] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 with Priority: HIGHEST for action security_group_rules [ 809.263251] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 with Priority: HIGHEST for action security_group_members [ 809.263345] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c8c733-53c0-479b-9e64-0ae9cff1647d with Priority: HIGHEST for action port [ 809.263835] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dea05fd0-2f31-49b2-a904-3b840403e3a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.263960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.264156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.264382] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.264516] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dea05fd0-2f31-49b2-a904-3b840403e3a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.265331] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea05fd0-2f31-49b2-a904-3b840403e3a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.265489] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.266550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.266550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.266550] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.266550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.266550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.266550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.266550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.266550] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dea05fd0-2f31-49b2-a904-3b840403e3a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.273156] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-33c8c733-53c0-479b-9e64-0ae9cff1647d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.273156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33c8c733-53c0-479b-9e64-0ae9cff1647d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.273156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33c8c733-53c0-479b-9e64-0ae9cff1647d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.273156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33c8c733-53c0-479b-9e64-0ae9cff1647d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.273156] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33c8c733-53c0-479b-9e64-0ae9cff1647d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.636158] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.636158] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.636158] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.636344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.636766] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.637712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.637712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.637712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.637712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.637712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.637712] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.637712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.637712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.638059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.638821] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.638821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.638821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.638821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.638821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.639018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.639188] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.752808] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f6ea965-586b-4847-a20f-3619378cb260',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.772987] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea05fd0-2f31-49b2-a904-3b840403e3a7 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.773205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.774559] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dea05fd0-2f31-49b2-a904-3b840403e3a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.781278] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33c8c733-53c0-479b-9e64-0ae9cff1647d with status ACTIVE [ 809.781278] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.781278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.781278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.781278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.781278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.781278] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.781278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.781278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.781278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.781278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.781278] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.781278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.781278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.781886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.781886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.781886] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33c8c733-53c0-479b-9e64-0ae9cff1647d is going to be updated. [ 809.812049] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.812220] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.812290] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.812536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.812746] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.812876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33c8c733-53c0-479b-9e64-0ae9cff1647d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.000194] env[71140]: INFO networking_nsxv3.common.synchronization [None req-97179f99-51cc-4fd3-9030-1f402796dcf7 None None] Enqueued Resource ID: 02dd96d1-612f-47ef-8b4f-def830c2da9d with Priority: HIGHEST for action port [ 810.000194] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02dd96d1-612f-47ef-8b4f-def830c2da9d with Priority: HIGHEST for action port [ 810.000194] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-02dd96d1-612f-47ef-8b4f-def830c2da9d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.000194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02dd96d1-612f-47ef-8b4f-def830c2da9d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.000194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02dd96d1-612f-47ef-8b4f-def830c2da9d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.000194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02dd96d1-612f-47ef-8b4f-def830c2da9d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.000194] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02dd96d1-612f-47ef-8b4f-def830c2da9d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.142132] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e: rpc.has_security_group_logging(os_id): False [ 810.162312] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.162598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.162598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.162902] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.162902] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.163064] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.163164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.163227] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.163399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.163479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.163667] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.163784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.163848] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.163993] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.164080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.164283] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.164617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.165331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.165594] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.169021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.169021] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be updated. [ 810.245844] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.245844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.245844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.245844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.245844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.257201] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f6ea965-586b-4847-a20f-3619378cb260: rpc.has_security_group_logging(os_id): False [ 810.262779] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: IN_PROGRESS for 2s [ 810.276238] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.276238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.276238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.276238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.276238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.276238] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.276558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.276558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.276627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.276797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.276923] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f6ea965-586b-4847-a20f-3619378cb260 is going to be created. [ 810.283367] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dea05fd0-2f31-49b2-a904-3b840403e3a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.358433] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.358666] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.358666] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.358877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.360063] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.370736] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f6ea965-586b-4847-a20f-3619378cb260 in Status: IN_PROGRESS for 2s [ 810.424137] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 810.424476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.504094] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02dd96d1-612f-47ef-8b4f-def830c2da9d [ 810.505114] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.505114] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.505114] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.505114] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.505396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.505396] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02dd96d1-612f-47ef-8b4f-def830c2da9d already deleted. [ 810.505396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02dd96d1-612f-47ef-8b4f-def830c2da9d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.787025] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.787025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.787025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.787305] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.787305] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.787385] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 is going to be created. [ 810.811027] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.811027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.811027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.811027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.811027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.823264] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 in Status: UNINITIALIZED for 2s [ 812.277451] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 812.277755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.384249] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f6ea965-586b-4847-a20f-3619378cb260 in Status: SUCCESS [ 812.384453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.628194] env[71140]: INFO networking_nsxv3.common.synchronization [None req-cf4ecf25-7146-4b44-923b-5ad6f48ee1a7 None None] Enqueued Resource ID: 14adba44-b220-4611-b50f-9c9e9ecb0915 with Priority: HIGHEST for action port [ 812.628194] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14adba44-b220-4611-b50f-9c9e9ecb0915 with Priority: HIGHEST for action port [ 812.628194] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-14adba44-b220-4611-b50f-9c9e9ecb0915 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.628194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14adba44-b220-4611-b50f-9c9e9ecb0915" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.628194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14adba44-b220-4611-b50f-9c9e9ecb0915" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.628835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14adba44-b220-4611-b50f-9c9e9ecb0915" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.629110] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14adba44-b220-4611-b50f-9c9e9ecb0915',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.832483] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 in Status: SUCCESS [ 812.832712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.832882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.833115] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.833309] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.833427] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.833484] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.833632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.833723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.833829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.833919] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dea05fd0-2f31-49b2-a904-3b840403e3a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.138643] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14adba44-b220-4611-b50f-9c9e9ecb0915 [ 813.138643] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.138643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.138643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.138643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.138643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.138643] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14adba44-b220-4611-b50f-9c9e9ecb0915 already deleted. [ 813.138643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14adba44-b220-4611-b50f-9c9e9ecb0915" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.336625] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea05fd0-2f31-49b2-a904-3b840403e3a7 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.337913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.337913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.337913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.337913] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.338256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.338256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.338417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.338543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.338659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.338819] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea05fd0-2f31-49b2-a904-3b840403e3a7 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.338958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.339043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.339228] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.339378] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.339475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.339650] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.339681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.339748] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.339833] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.339922] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dea05fd0-2f31-49b2-a904-3b840403e3a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.843564] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dea05fd0-2f31-49b2-a904-3b840403e3a7: rpc.has_security_group_logging(os_id): False [ 813.865405] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.865405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.865405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.865405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.865405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.865405] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.865405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.865405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.865405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.865405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.865405] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.865405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.865405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.865981] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.865981] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.866996] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.867399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.867608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.867935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.869722] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.869722] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 is going to be created. [ 813.946982] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.946982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.946982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.946982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.946982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.956657] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 in Status: IN_PROGRESS for 2s [ 814.634843] env[71140]: INFO networking_nsxv3.common.synchronization [req-e4dcc84b-e089-450c-8d89-db7b17744672 req-c2a53c6e-b609-413f-88fe-b9af4a909384 tempest-ServersTestMultiNic-1825947710 tempest-ServersTestMultiNic-1825947710-project-member] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 814.635486] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 814.635844] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.635959] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.636236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.636376] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.636596] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.636729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.636826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.637084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.637183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.637286] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.916493] env[71140]: INFO networking_nsxv3.common.synchronization [req-e4dcc84b-e089-450c-8d89-db7b17744672 req-de3eb28b-56f2-4539-8177-b0e126c625c4 tempest-ServersTestMultiNic-1825947710 tempest-ServersTestMultiNic-1825947710-project-member] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 814.919883] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 814.921075] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.922220] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.145856] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.348464] env[71140]: INFO networking_nsxv3.common.synchronization [req-e4dcc84b-e089-450c-8d89-db7b17744672 req-564d903f-4c7f-4638-9c23-2df8a368a27e tempest-ServersTestMultiNic-1825947710 tempest-ServersTestMultiNic-1825947710-project-member] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 815.349204] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 815.349526] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.349623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.646671] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.841607] env[71140]: INFO networking_nsxv3.common.synchronization [req-858bb374-52cb-4be3-b898-7559b30d24d1 req-941fa3be-a944-4d04-892a-546633958c01 tempest-VolumesAdminNegativeTest-302320000 tempest-VolumesAdminNegativeTest-302320000-project-member] Enqueued Resource ID: a008c941-3472-43c0-815f-ad4259496329 with Priority: HIGHEST for action security_group_members [ 815.845178] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a008c941-3472-43c0-815f-ad4259496329 with Priority: HIGHEST for action security_group_members [ 815.845178] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a008c941-3472-43c0-815f-ad4259496329 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.845178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.845178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.845178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.845178] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.845178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.845178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.845178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.845178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.845178] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a008c941-3472-43c0-815f-ad4259496329',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.970800] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 in Status: SUCCESS [ 815.971207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.150060] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.151013] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.151013] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.151013] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.151013] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.151254] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be updated. [ 816.178727] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.179283] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.179283] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.179283] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.179421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.188328] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: IN_PROGRESS for 2s [ 816.347653] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.347883] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.347967] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.348276] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.348382] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.348609] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.348725] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.348815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.349156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.349265] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.349265] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a008c941-3472-43c0-815f-ad4259496329 already deleted. [ 816.349377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.506889] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-685 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.506889] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-685" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.508168] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-685" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.508727] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-685" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.508904] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.509191] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.509356] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.509815] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.509914] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.510226] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.510472] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.510543] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.510714] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.510886] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.511182] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.511237] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.532119] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.532348] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 816.532567] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.532683] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-685" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.535395] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-82a952f5-d2da-4aee-9eab-19e958282582 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.535395] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-82a952f5-d2da-4aee-9eab-19e958282582" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.535395] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-82a952f5-d2da-4aee-9eab-19e958282582" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.535887] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-82a952f5-d2da-4aee-9eab-19e958282582" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.537324] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82a952f5-d2da-4aee-9eab-19e958282582',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.040879] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.040879] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.040879] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.041327] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.041327] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.041327] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 82a952f5-d2da-4aee-9eab-19e958282582 not found, creating... [ 817.041577] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.041934] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.041934] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.042129] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.042230] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.042603] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.042691] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.042865] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.043037] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.043186] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.043309] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 82a952f5-d2da-4aee-9eab-19e958282582 is going to be created. [ 817.063412] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.063685] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.063771] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.064013] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.064249] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.064480] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-82a952f5-d2da-4aee-9eab-19e958282582" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.652350] env[71140]: INFO networking_nsxv3.common.synchronization [None req-34c4d21f-8c4b-41c9-b304-96942ebbc70c None None] Enqueued Resource ID: c3cfccaa-f0e9-4eb9-afac-82e9d86a91eb with Priority: HIGHEST for action port [ 817.652943] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3cfccaa-f0e9-4eb9-afac-82e9d86a91eb with Priority: HIGHEST for action port [ 817.653281] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3cfccaa-f0e9-4eb9-afac-82e9d86a91eb taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.653414] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3cfccaa-f0e9-4eb9-afac-82e9d86a91eb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.653493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3cfccaa-f0e9-4eb9-afac-82e9d86a91eb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.653851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3cfccaa-f0e9-4eb9-afac-82e9d86a91eb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.653851] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3cfccaa-f0e9-4eb9-afac-82e9d86a91eb',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.114843] env[71140]: INFO networking_nsxv3.common.synchronization [req-858bb374-52cb-4be3-b898-7559b30d24d1 req-955d03a7-4e60-47bb-b977-3d889aed7098 service nova] Enqueued Resource ID: a008c941-3472-43c0-815f-ad4259496329 with Priority: HIGHEST for action security_group_rules [ 818.114843] env[71140]: INFO networking_nsxv3.common.synchronization [req-858bb374-52cb-4be3-b898-7559b30d24d1 req-955d03a7-4e60-47bb-b977-3d889aed7098 service nova] Enqueued Resource ID: a008c941-3472-43c0-815f-ad4259496329 with Priority: HIGHEST for action security_group_members [ 818.114843] env[71140]: INFO networking_nsxv3.common.synchronization [req-858bb374-52cb-4be3-b898-7559b30d24d1 req-955d03a7-4e60-47bb-b977-3d889aed7098 service nova] Enqueued Resource ID: 82a952f5-d2da-4aee-9eab-19e958282582 with Priority: HIGHEST for action port [ 818.114843] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a008c941-3472-43c0-815f-ad4259496329 with Priority: HIGHEST for action security_group_rules [ 818.114843] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a008c941-3472-43c0-815f-ad4259496329 with Priority: HIGHEST for action security_group_members [ 818.115497] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82a952f5-d2da-4aee-9eab-19e958282582 with Priority: HIGHEST for action port [ 818.115575] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a008c941-3472-43c0-815f-ad4259496329 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.115689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.115758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.116455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.116455] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a008c941-3472-43c0-815f-ad4259496329',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.117598] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a008c941-3472-43c0-815f-ad4259496329 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.117752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.117827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.118078] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.118216] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.118320] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.118384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.118549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.118615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.118722] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a008c941-3472-43c0-815f-ad4259496329',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.119916] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-82a952f5-d2da-4aee-9eab-19e958282582 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.119916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82a952f5-d2da-4aee-9eab-19e958282582" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.119916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82a952f5-d2da-4aee-9eab-19e958282582" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.120153] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82a952f5-d2da-4aee-9eab-19e958282582" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.120153] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82a952f5-d2da-4aee-9eab-19e958282582',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.163140] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3cfccaa-f0e9-4eb9-afac-82e9d86a91eb [ 818.163140] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.163140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.163140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.163140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.163140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.163140] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3cfccaa-f0e9-4eb9-afac-82e9d86a91eb already deleted. [ 818.163140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3cfccaa-f0e9-4eb9-afac-82e9d86a91eb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.200040] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 818.200441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.200689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.201088] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.201396] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.201607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.201741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.202055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.202221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.202397] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.359049] env[71140]: INFO networking_nsxv3.common.synchronization [req-c34e7033-e29f-4044-bb10-0579865b5b92 req-fb1cf5e5-08bf-4abd-a7dd-5b0de5d8bb32 tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 818.359826] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 818.360325] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.360325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.360325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.360594] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.360594] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.360708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.360708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.361763] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.361763] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.361869] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.623401] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a008c941-3472-43c0-815f-ad4259496329',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.624499] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a008c941-3472-43c0-815f-ad4259496329 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.624610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.624770] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82a952f5-d2da-4aee-9eab-19e958282582 with status ACTIVE [ 818.624927] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.625040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.625106] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.625308] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.625395] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.625558] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.625654] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.627141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.627141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.627141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.627141] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.627141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.627141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.627141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.627141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.627141] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82a952f5-d2da-4aee-9eab-19e958282582 is going to be updated. [ 818.647937] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.647937] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.647937] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.648215] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.648250] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.648676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82a952f5-d2da-4aee-9eab-19e958282582" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.706025] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.706204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.706253] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.706817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.706817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.706817] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.707032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.707032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.707149] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.707226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.707315] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be updated. [ 818.729332] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-19 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.729561] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-19" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.729771] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-19" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.730110] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-19" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.730510] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.730705] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.730837] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.731163] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.731367] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.731614] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 818.731780] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 818.731961] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 818.732115] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 818.732236] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 818.732343] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 818.732478] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 818.745639] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.745639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.745639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.745639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.745639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.752563] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: IN_PROGRESS for 2s [ 818.758213] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 818.758393] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 818.758541] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 818.758714] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-19" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.759052] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-b320a11a-f743-474c-bada-ba0ac6f9335f taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.759282] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-b320a11a-f743-474c-bada-ba0ac6f9335f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.759413] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-b320a11a-f743-474c-bada-ba0ac6f9335f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.759747] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-b320a11a-f743-474c-bada-ba0ac6f9335f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.759891] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b320a11a-f743-474c-bada-ba0ac6f9335f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.865873] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.128782] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a008c941-3472-43c0-815f-ad4259496329',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.262642] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.262878] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.262988] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.263337] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.263504] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.263661] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port b320a11a-f743-474c-bada-ba0ac6f9335f not found, creating... [ 819.265238] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.265486] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.265615] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.265963] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.266190] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.266544] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.266804] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.266984] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.267270] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.267444] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.267617] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: b320a11a-f743-474c-bada-ba0ac6f9335f is going to be created. [ 819.291643] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.291863] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.292047] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.292311] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.292552] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.292799] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-b320a11a-f743-474c-bada-ba0ac6f9335f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.370362] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.633812] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.633812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.633812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.633812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.633812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.633812] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a008c941-3472-43c0-815f-ad4259496329 is going to be created. [ 819.658251] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.658251] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.658251] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.658251] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.658251] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.665391] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a008c941-3472-43c0-815f-ad4259496329 in Status: UNINITIALIZED for 2s [ 819.876260] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.876260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.876260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.876260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.876260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.876260] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 819.908645] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.908645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.908645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.908645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.908645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.915882] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 819.982996] env[71140]: INFO networking_nsxv3.common.synchronization [req-c34e7033-e29f-4044-bb10-0579865b5b92 req-b74d93c7-89f6-41b8-8885-4a7ddddbd252 service nova] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_rules [ 819.982996] env[71140]: INFO networking_nsxv3.common.synchronization [req-c34e7033-e29f-4044-bb10-0579865b5b92 req-b74d93c7-89f6-41b8-8885-4a7ddddbd252 service nova] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 819.982996] env[71140]: INFO networking_nsxv3.common.synchronization [req-c34e7033-e29f-4044-bb10-0579865b5b92 req-b74d93c7-89f6-41b8-8885-4a7ddddbd252 service nova] Enqueued Resource ID: b320a11a-f743-474c-bada-ba0ac6f9335f with Priority: HIGHEST for action port [ 819.982996] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_rules [ 819.983325] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 819.983555] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b320a11a-f743-474c-bada-ba0ac6f9335f with Priority: HIGHEST for action port [ 819.984043] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.984311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.984491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.984816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.985035] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.986017] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.986258] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.986574] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-b320a11a-f743-474c-bada-ba0ac6f9335f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.986839] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b320a11a-f743-474c-bada-ba0ac6f9335f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.987040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b320a11a-f743-474c-bada-ba0ac6f9335f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.987341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b320a11a-f743-474c-bada-ba0ac6f9335f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.987515] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b320a11a-f743-474c-bada-ba0ac6f9335f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.102873] env[71140]: INFO networking_nsxv3.common.synchronization [None req-883f5448-70c5-4f86-b35c-97292a9015bb None None] Enqueued Resource ID: 03f0725c-060c-4d30-a11d-9f654a2788b0 with Priority: HIGHEST for action port [ 820.103202] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03f0725c-060c-4d30-a11d-9f654a2788b0 with Priority: HIGHEST for action port [ 820.104423] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-03f0725c-060c-4d30-a11d-9f654a2788b0 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.104423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03f0725c-060c-4d30-a11d-9f654a2788b0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.104423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03f0725c-060c-4d30-a11d-9f654a2788b0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.104423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03f0725c-060c-4d30-a11d-9f654a2788b0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.104423] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03f0725c-060c-4d30-a11d-9f654a2788b0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.492688] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.493277] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.493277] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b320a11a-f743-474c-bada-ba0ac6f9335f with status ACTIVE [ 820.493399] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.493553] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.493635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.493861] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.493997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.494228] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.494349] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.494431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.494663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.494799] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.495018] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.495150] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.495244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.495418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.495520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.495627] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b320a11a-f743-474c-bada-ba0ac6f9335f is going to be updated. [ 820.523804] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.524061] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.524130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.524424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.524618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.524869] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b320a11a-f743-474c-bada-ba0ac6f9335f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.606597] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03f0725c-060c-4d30-a11d-9f654a2788b0 [ 820.606923] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.607151] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.607249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.607514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.607633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.607869] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03f0725c-060c-4d30-a11d-9f654a2788b0 already deleted. [ 820.607869] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03f0725c-060c-4d30-a11d-9f654a2788b0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.787806] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 820.788076] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e deletion is rescheduled due to dependency. [ 820.788224] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.788893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.789217] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.789455] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.789604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.789691] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.789894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.790010] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.790139] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.293084] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.293297] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.293297] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.293503] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.293597] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.293800] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.293903] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.293966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.294163] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.294275] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.294370] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be updated. [ 821.321112] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.321325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.321374] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.321552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.321694] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.331364] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: IN_PROGRESS for 2s [ 821.674515] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a008c941-3472-43c0-815f-ad4259496329 in Status: SUCCESS [ 821.674902] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.674949] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.675168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.675789] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.675789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.675789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.675789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.675789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.676100] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.676100] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a008c941-3472-43c0-815f-ad4259496329',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.928089] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 821.928089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.928089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.928089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.928089] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.928089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.928089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.928089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.928089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.928089] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.179080] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a008c941-3472-43c0-815f-ad4259496329 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.179264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.179354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.179553] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.179728] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.179835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.179916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.180076] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.180169] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.180260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.180413] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a008c941-3472-43c0-815f-ad4259496329 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.180507] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.180595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.180735] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.180886] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.180976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.181090] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.181225] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.181315] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.181373] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.181483] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a008c941-3472-43c0-815f-ad4259496329',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.432178] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.685527] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a008c941-3472-43c0-815f-ad4259496329: rpc.has_security_group_logging(os_id): False [ 822.705805] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.705805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.705805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.705805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.705805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.705805] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.705805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.705805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.705805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.705805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.705805] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.705805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.705805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.706799] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.706799] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.707858] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.707858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.708886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.708886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.708886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.708886] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a008c941-3472-43c0-815f-ad4259496329 is going to be created. [ 822.769376] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.769601] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.769728] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.770089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.770378] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.788064] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a008c941-3472-43c0-815f-ad4259496329 in Status: IN_PROGRESS for 2s [ 822.792540] env[71140]: INFO networking_nsxv3.common.synchronization [None req-3461c4d3-fcd7-408f-8424-d65ae843ca13 tempest-ImagesOneServerNegativeTestJSON-512607698 tempest-ImagesOneServerNegativeTestJSON-512607698-project-member] Enqueued Resource ID: a27563fa-19a4-45a9-9750-1e3da462b28e with Priority: HIGHEST for action security_group_rules [ 822.793761] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a27563fa-19a4-45a9-9750-1e3da462b28e with Priority: HIGHEST for action security_group_rules [ 822.794176] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a27563fa-19a4-45a9-9750-1e3da462b28e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.794366] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a27563fa-19a4-45a9-9750-1e3da462b28e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.794510] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a27563fa-19a4-45a9-9750-1e3da462b28e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.795538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a27563fa-19a4-45a9-9750-1e3da462b28e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.795538] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a27563fa-19a4-45a9-9750-1e3da462b28e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.882173] env[71140]: INFO networking_nsxv3.common.synchronization [None req-8ad89cf8-7326-4c9e-b6d1-fd6a54350f6d tempest-ImagesOneServerNegativeTestJSON-512607698 tempest-ImagesOneServerNegativeTestJSON-512607698-project-member] Enqueued Resource ID: a27563fa-19a4-45a9-9750-1e3da462b28e with Priority: HIGHEST for action security_group_rules [ 822.882595] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a27563fa-19a4-45a9-9750-1e3da462b28e with Priority: HIGHEST for action security_group_rules [ 822.883058] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a27563fa-19a4-45a9-9750-1e3da462b28e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.883165] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a27563fa-19a4-45a9-9750-1e3da462b28e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.936400] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.318255] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.318447] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.318516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.318726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.318819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.318933] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a27563fa-19a4-45a9-9750-1e3da462b28e already deleted. [ 823.319074] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a27563fa-19a4-45a9-9750-1e3da462b28e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.319281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a27563fa-19a4-45a9-9750-1e3da462b28e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.319513] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a27563fa-19a4-45a9-9750-1e3da462b28e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.319612] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a27563fa-19a4-45a9-9750-1e3da462b28e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.343402] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 823.343612] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e deletion is rescheduled due to dependency. [ 823.343794] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.438808] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.438964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.439162] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.439406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.439561] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.439622] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 823.482756] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.483167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.483297] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.483624] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.483818] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.493183] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 823.843058] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.843058] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.843058] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.843058] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.845405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.845405] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a27563fa-19a4-45a9-9750-1e3da462b28e already deleted. [ 823.845405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a27563fa-19a4-45a9-9750-1e3da462b28e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.799880] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a008c941-3472-43c0-815f-ad4259496329 in Status: SUCCESS [ 824.800504] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.978788] env[71140]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] NSXv3 Agent Agent loop - iteration:0 completed [ 824.979133] env[71140]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] NSXv3 Agent Agent loop - iteration:1 started [ 825.503809] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 825.503912] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.504222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.504502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.504780] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.504966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.505072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.505292] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.505401] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.505555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.505722] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.883290] env[71140]: INFO networking_nsxv3.common.synchronization [req-795560ce-35b2-4f3c-99a6-0219b618da52 req-ce7cc4ad-6e7c-4a0f-8957-8a40ae42adff tempest-ServersAdminTestJSON-2080308680 tempest-ServersAdminTestJSON-2080308680-project-member] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 825.884133] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 825.884506] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.884638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.884707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.884915] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.885080] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.885234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.885298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.885883] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.885883] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.885883] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.889883] env[71140]: INFO networking_nsxv3.common.synchronization [req-6a96cc52-2b46-4f9d-825f-554093e4b001 req-0a000ff1-d6f4-4bcf-9635-898ff0c4ba00 tempest-ListServerFiltersTestJSON-1641915528 tempest-ListServerFiltersTestJSON-1641915528-project-member] Enqueued Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 825.889883] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGHEST for action security_group_members [ 825.890675] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.890675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.890675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.890851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.890885] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.890970] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.891057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.891196] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.891277] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.891364] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.008747] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.008747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.008747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.009148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.009249] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.009481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.009481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.009627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.009765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.009915] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.010081] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.010194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.010282] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.010472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.010672] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.010778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.010847] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.011037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.011127] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.011337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.011409] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.390247] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.393465] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.393630] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.393706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.394010] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.394010] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.394218] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.394322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.394385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.394549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.394627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.394715] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 is going to be updated. [ 826.423227] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.423367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.423441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.423663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.423808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.440388] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: IN_PROGRESS for 2s [ 826.516450] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470: rpc.has_security_group_logging(os_id): False [ 826.534559] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.534559] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.534559] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.534559] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.534559] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.534750] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.534750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.534824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.535463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.535463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.535463] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.535463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.535463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.535690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.535690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.535778] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.536715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.536715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.536715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.536715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.536715] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 826.602530] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.602679] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.603574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.603574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.603574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.617761] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 826.893009] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.395915] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.396244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.396244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.396383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.396480] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.396592] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be updated. [ 827.422987] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.423173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.423244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.423465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.423662] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.432465] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: IN_PROGRESS for 2s [ 828.451494] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 in Status: SUCCESS [ 828.451890] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 deletion is rescheduled due to dependency. [ 828.451959] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.633643] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 828.633738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.987051] env[71140]: INFO networking_nsxv3.common.synchronization [req-875b52fa-bfca-4bce-9000-b001676d6f99 req-9f1210f9-43a7-4828-a2e2-b5df75de9740 tempest-ServerTagsTestJSON-420786443 tempest-ServerTagsTestJSON-420786443-project-member] Enqueued Resource ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 with Priority: HIGHEST for action security_group_members [ 828.988760] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 with Priority: HIGHEST for action security_group_members [ 828.988760] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea05fd0-2f31-49b2-a904-3b840403e3a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.988760] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.988760] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.988760] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.989128] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.989128] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.989128] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.989256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.989655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.989655] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dea05fd0-2f31-49b2-a904-3b840403e3a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.291021] env[71140]: INFO networking_nsxv3.common.synchronization [req-c0e99d97-3b32-4dd5-8799-c585bbe88d15 req-321ba022-064f-4058-b2cb-d9be71ef7d70 tempest-ImagesOneServerTestJSON-1662922748 tempest-ImagesOneServerTestJSON-1662922748-project-member] Enqueued Resource ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 with Priority: HIGHEST for action security_group_members [ 829.291365] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 with Priority: HIGHEST for action security_group_members [ 829.291886] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.292197] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.294530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.294530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.294530] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.294530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.294530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.294530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.294530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.294530] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2ad47d5-b746-415d-9e5e-05d9539a1fb9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.443904] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: SUCCESS [ 829.443904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.492300] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.492300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.492300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.493241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.493241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.493241] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.493241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.493241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.493241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.493241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.493810] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 is going to be updated. [ 829.519118] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.519391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.519500] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.519718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.519908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.529195] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 in Status: IN_PROGRESS for 2s [ 829.796406] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.796557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.796631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.796925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.796997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.797259] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.797387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.797387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.797753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.797753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.797753] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 is going to be updated. [ 829.825937] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.826110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.826180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.826390] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.826524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.840995] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 in Status: IN_PROGRESS for 2s [ 830.426544] env[71140]: INFO networking_nsxv3.common.synchronization [req-aa17eb6b-1f02-4343-a917-7b5f06a4e1f3 req-9fc0abea-34ca-4cde-a58f-5482d48ec5d1 tempest-ServerDiskConfigTestJSON-63292790 tempest-ServerDiskConfigTestJSON-63292790-project-member] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 830.426996] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 830.427525] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.427525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.427525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.430681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.430681] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.432143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.432143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.432143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.432143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.432143] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.448076] env[71140]: INFO networking_nsxv3.common.synchronization [req-f419dd4e-dcd4-4d5a-a924-9521c0822cfd req-84e542ad-47b1-4f9e-8b69-b19b1f35c9cf tempest-FloatingIPsAssociationTestJSON-945479351 tempest-FloatingIPsAssociationTestJSON-945479351-project-member] Enqueued Resource ID: f9ec394c-128b-4456-9eb1-76442418ea09 with Priority: HIGHEST for action security_group_members [ 830.448597] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ec394c-128b-4456-9eb1-76442418ea09 with Priority: HIGHEST for action security_group_members [ 830.448814] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ec394c-128b-4456-9eb1-76442418ea09 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.449014] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.449014] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.449180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.452636] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.452636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.452636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.453665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.453665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.453665] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.925698] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-952 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.926132] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-952" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.926132] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-952" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.926222] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-952" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.927927] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.928121] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.928243] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.928959] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.928959] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.928959] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 830.928959] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 830.929226] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 830.929226] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 830.931142] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 830.931142] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 830.931142] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 830.933820] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.933917] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.933988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.934565] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.934565] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.934565] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.934565] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.934811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.934811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.934908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.935080] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 830.949235] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 830.949235] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 830.949235] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 830.949481] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-952" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.949593] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-42c3baff-3fb1-4abc-9448-5c687a6eb896 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.949788] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-42c3baff-3fb1-4abc-9448-5c687a6eb896" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.949889] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-42c3baff-3fb1-4abc-9448-5c687a6eb896" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.950236] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-42c3baff-3fb1-4abc-9448-5c687a6eb896" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.950372] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42c3baff-3fb1-4abc-9448-5c687a6eb896',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.959358] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.959932] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.960109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.960188] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.960394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.960525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.970175] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 831.125848] env[71140]: INFO networking_nsxv3.common.synchronization [req-1152a3fc-9143-4bf2-b7ca-0adf20f50252 req-71445ced-62e0-4bcb-ba45-82496ea3316d tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 with Priority: HIGHEST for action security_group_members [ 831.126158] env[71140]: INFO networking_nsxv3.common.synchronization [req-1152a3fc-9143-4bf2-b7ca-0adf20f50252 req-71445ced-62e0-4bcb-ba45-82496ea3316d tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 831.127604] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 with Priority: HIGHEST for action security_group_members [ 831.127604] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 831.127889] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a300b78-a05e-47a1-bd01-b7e39a483342 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.127972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.129034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.130547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.130547] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.130547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.130547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.130547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.130547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.130547] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.136979] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.142797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.142797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.142797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.142797] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.142797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.142797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.142797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.142797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.142797] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.185180] env[71140]: INFO networking_nsxv3.common.synchronization [req-1152a3fc-9143-4bf2-b7ca-0adf20f50252 req-71445ced-62e0-4bcb-ba45-82496ea3316d tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 with Priority: HIGHEST for action security_group_rules [ 831.185357] env[71140]: INFO networking_nsxv3.common.synchronization [req-1152a3fc-9143-4bf2-b7ca-0adf20f50252 req-71445ced-62e0-4bcb-ba45-82496ea3316d tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 with Priority: HIGHEST for action security_group_members [ 831.185521] env[71140]: INFO networking_nsxv3.common.synchronization [req-1152a3fc-9143-4bf2-b7ca-0adf20f50252 req-71445ced-62e0-4bcb-ba45-82496ea3316d tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_rules [ 831.185651] env[71140]: INFO networking_nsxv3.common.synchronization [req-1152a3fc-9143-4bf2-b7ca-0adf20f50252 req-71445ced-62e0-4bcb-ba45-82496ea3316d tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 831.186031] env[71140]: INFO networking_nsxv3.common.synchronization [req-1152a3fc-9143-4bf2-b7ca-0adf20f50252 req-71445ced-62e0-4bcb-ba45-82496ea3316d tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: b320a11a-f743-474c-bada-ba0ac6f9335f with Priority: HIGHEST for action port [ 831.186297] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 with Priority: HIGHEST for action security_group_rules [ 831.186428] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_rules [ 831.186526] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b320a11a-f743-474c-bada-ba0ac6f9335f with Priority: HIGHEST for action port [ 831.186617] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 with Priority: HIGHEST for action security_group_members [ 831.187682] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 831.188219] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a300b78-a05e-47a1-bd01-b7e39a483342 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.188219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.188219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.188522] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.188612] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.189590] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.189708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.189817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.190103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.190185] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.190965] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-b320a11a-f743-474c-bada-ba0ac6f9335f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.191143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b320a11a-f743-474c-bada-ba0ac6f9335f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.191226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b320a11a-f743-474c-bada-ba0ac6f9335f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.191668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b320a11a-f743-474c-bada-ba0ac6f9335f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.191754] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b320a11a-f743-474c-bada-ba0ac6f9335f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.192915] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a300b78-a05e-47a1-bd01-b7e39a483342 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.193063] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.193362] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.193443] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.334511] env[71140]: INFO networking_nsxv3.common.synchronization [None req-4c8d4edd-f21b-49de-8f10-441a26507f59 None None] Enqueued Resource ID: 97f1b26f-64ee-40d4-b4c9-9b79daf7115e with Priority: HIGHEST for action port [ 831.335637] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97f1b26f-64ee-40d4-b4c9-9b79daf7115e with Priority: HIGHEST for action port [ 831.336089] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-97f1b26f-64ee-40d4-b4c9-9b79daf7115e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.336219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97f1b26f-64ee-40d4-b4c9-9b79daf7115e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.336301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97f1b26f-64ee-40d4-b4c9-9b79daf7115e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.336580] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97f1b26f-64ee-40d4-b4c9-9b79daf7115e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.336779] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97f1b26f-64ee-40d4-b4c9-9b79daf7115e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.459865] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.459865] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.459865] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.459865] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.459865] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.459865] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 42c3baff-3fb1-4abc-9448-5c687a6eb896 not found, creating... [ 831.460575] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.460575] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.460575] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.460575] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.460723] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.462096] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.462363] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.462440] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.462680] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.464059] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.464059] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 42c3baff-3fb1-4abc-9448-5c687a6eb896 is going to be created. [ 831.464509] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.485053] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.485053] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.485053] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.485053] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.485053] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.485053] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-42c3baff-3fb1-4abc-9448-5c687a6eb896" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.538071] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 in Status: SUCCESS [ 831.540283] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dea05fd0-2f31-49b2-a904-3b840403e3a7 deletion is rescheduled due to dependency. [ 831.540283] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea05fd0-2f31-49b2-a904-3b840403e3a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.645895] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.653012] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.696141] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a300b78-a05e-47a1-bd01-b7e39a483342 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.696141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.696141] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.696141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.698215] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b320a11a-f743-474c-bada-ba0ac6f9335f with status ACTIVE [ 831.698440] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.698551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.698618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.698822] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.698907] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.699097] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.699190] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.699252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.699406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.699480] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.699655] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.699743] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.699800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.699944] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.700043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.700097] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b320a11a-f743-474c-bada-ba0ac6f9335f is going to be updated. [ 831.725450] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.725689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.725689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.725861] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.725993] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.726195] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b320a11a-f743-474c-bada-ba0ac6f9335f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.840408] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97f1b26f-64ee-40d4-b4c9-9b79daf7115e [ 831.840408] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.840408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.840408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.840408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.840408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.840408] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97f1b26f-64ee-40d4-b4c9-9b79daf7115e already deleted. [ 831.840408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97f1b26f-64ee-40d4-b4c9-9b79daf7115e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.854133] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 in Status: SUCCESS [ 831.854385] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2ad47d5-b746-415d-9e5e-05d9539a1fb9 deletion is rescheduled due to dependency. [ 831.854506] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2ad47d5-b746-415d-9e5e-05d9539a1fb9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.971826] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.972162] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.973985] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.973985] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.973985] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.973985] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9ec394c-128b-4456-9eb1-76442418ea09 is going to be updated. [ 832.000918] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.001134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.001636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.002028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.002274] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.013032] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9ec394c-128b-4456-9eb1-76442418ea09 in Status: IN_PROGRESS for 2s [ 832.156137] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.157168] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.232437] env[71140]: INFO networking_nsxv3.common.synchronization [req-0ed38b5c-9bdf-4d42-bd69-71430081b0c8 req-0a953116-5fb1-4dfe-b719-b51e28d2dcfe tempest-VolumesAdminNegativeTest-302320000 tempest-VolumesAdminNegativeTest-302320000-project-member] Enqueued Resource ID: a008c941-3472-43c0-815f-ad4259496329 with Priority: HIGHEST for action security_group_members [ 832.233659] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a008c941-3472-43c0-815f-ad4259496329 with Priority: HIGHEST for action security_group_members [ 832.234086] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a008c941-3472-43c0-815f-ad4259496329 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.234258] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.235234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.235234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.235234] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.235234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.235234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.235578] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.236475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.236632] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a008c941-3472-43c0-815f-ad4259496329',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.483910] env[71140]: INFO networking_nsxv3.common.synchronization [req-f419dd4e-dcd4-4d5a-a924-9521c0822cfd req-7bb6de69-b999-49e3-8ea2-bfadced6a157 service nova] Enqueued Resource ID: f9ec394c-128b-4456-9eb1-76442418ea09 with Priority: HIGHEST for action security_group_rules [ 832.484212] env[71140]: INFO networking_nsxv3.common.synchronization [req-f419dd4e-dcd4-4d5a-a924-9521c0822cfd req-7bb6de69-b999-49e3-8ea2-bfadced6a157 service nova] Enqueued Resource ID: f9ec394c-128b-4456-9eb1-76442418ea09 with Priority: HIGHEST for action security_group_members [ 832.484212] env[71140]: INFO networking_nsxv3.common.synchronization [req-f419dd4e-dcd4-4d5a-a924-9521c0822cfd req-7bb6de69-b999-49e3-8ea2-bfadced6a157 service nova] Enqueued Resource ID: 42c3baff-3fb1-4abc-9448-5c687a6eb896 with Priority: HIGHEST for action port [ 832.487911] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ec394c-128b-4456-9eb1-76442418ea09 with Priority: HIGHEST for action security_group_rules [ 832.488095] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ec394c-128b-4456-9eb1-76442418ea09 with Priority: HIGHEST for action security_group_members [ 832.488269] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42c3baff-3fb1-4abc-9448-5c687a6eb896 with Priority: HIGHEST for action port [ 832.488961] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9ec394c-128b-4456-9eb1-76442418ea09 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.490915] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.490915] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.490915] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.490915] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.490915] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ec394c-128b-4456-9eb1-76442418ea09 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.491274] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.491274] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-42c3baff-3fb1-4abc-9448-5c687a6eb896 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.491449] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42c3baff-3fb1-4abc-9448-5c687a6eb896" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.491449] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42c3baff-3fb1-4abc-9448-5c687a6eb896" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.491708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42c3baff-3fb1-4abc-9448-5c687a6eb896" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.491708] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42c3baff-3fb1-4abc-9448-5c687a6eb896',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.660278] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.660484] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.660484] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.660696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.660792] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.660891] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 is going to be created. [ 832.662195] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.662324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.662366] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.662530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.662612] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.662700] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 832.687406] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.687834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.687834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.687834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.687995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.690476] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.690585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.690658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.690837] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.690986] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.697423] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 in Status: UNINITIALIZED for 2s [ 832.698299] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 832.740426] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.740589] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.740664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.740870] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.740962] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.741207] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.741344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.741434] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.741576] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.741841] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.741841] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a008c941-3472-43c0-815f-ad4259496329 is going to be updated. [ 832.842830] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.842985] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.843073] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.843301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.843475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.851789] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a008c941-3472-43c0-815f-ad4259496329 in Status: IN_PROGRESS for 2s [ 832.978825] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 832.979112] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 deletion is rescheduled due to dependency. [ 832.979270] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.994255] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ec394c-128b-4456-9eb1-76442418ea09 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.994403] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.994647] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42c3baff-3fb1-4abc-9448-5c687a6eb896 with status ACTIVE [ 832.994720] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.994918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.994918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.995117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.995210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.995389] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.995490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.995555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.995758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.995797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.996055] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.996192] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.996235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.996353] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.996423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.996510] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42c3baff-3fb1-4abc-9448-5c687a6eb896 is going to be updated. [ 833.016176] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.016327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.016400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.016615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.016889] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.016982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42c3baff-3fb1-4abc-9448-5c687a6eb896" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.142197] env[71140]: INFO networking_nsxv3.common.synchronization [None req-421d0799-d904-4c95-861f-04a364d0fcb9 None None] Enqueued Resource ID: c5761047-1b47-4242-8e43-8d1bd41d0bc4 with Priority: HIGHEST for action port [ 833.142828] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5761047-1b47-4242-8e43-8d1bd41d0bc4 with Priority: HIGHEST for action port [ 833.143136] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5761047-1b47-4242-8e43-8d1bd41d0bc4 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.143281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5761047-1b47-4242-8e43-8d1bd41d0bc4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.143353] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5761047-1b47-4242-8e43-8d1bd41d0bc4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.143668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5761047-1b47-4242-8e43-8d1bd41d0bc4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.143755] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5761047-1b47-4242-8e43-8d1bd41d0bc4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.171390] env[71140]: INFO networking_nsxv3.common.synchronization [req-8bb1ac60-6aea-4fd3-9d13-3fc0cbffe5b8 req-123fd48b-905b-42b6-95f9-431772b5e908 tempest-DeleteServersTestJSON-1199867382 tempest-DeleteServersTestJSON-1199867382-project-member] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 833.172034] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 833.172588] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.172720] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.172797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.173058] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.173220] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.173324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.173397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.173539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.173629] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.173721] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.487120] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-351 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.487422] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.487494] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.487846] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.488152] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.488337] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.488476] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.488916] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.488916] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.489269] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.489269] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.489539] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.489539] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.489750] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.489750] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.489895] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 833.509728] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 833.509728] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 833.509728] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 833.509728] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.510079] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-2e582226-fe54-4ca1-b481-4764a5580301 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.510329] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-2e582226-fe54-4ca1-b481-4764a5580301" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.510490] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-2e582226-fe54-4ca1-b481-4764a5580301" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.510914] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-2e582226-fe54-4ca1-b481-4764a5580301" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.511141] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e582226-fe54-4ca1-b481-4764a5580301',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.646986] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5761047-1b47-4242-8e43-8d1bd41d0bc4 [ 833.647119] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.647298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.647500] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.647620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.647620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.647720] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5761047-1b47-4242-8e43-8d1bd41d0bc4 already deleted. [ 833.647911] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5761047-1b47-4242-8e43-8d1bd41d0bc4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.676312] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.676312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.676312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.676541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.676541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.676685] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.676829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.676872] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.677045] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.677128] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.677222] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be updated. [ 833.702671] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.703904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.703904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.704378] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.704378] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.714242] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 834.015092] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.015446] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.015446] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.015882] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.016036] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.016298] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 2e582226-fe54-4ca1-b481-4764a5580301 not found, creating... [ 834.016651] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.016963] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.017183] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.017571] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.017612] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.017949] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.018142] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.018275] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.018515] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.018695] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.018799] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 2e582226-fe54-4ca1-b481-4764a5580301 is going to be created. [ 834.028374] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9ec394c-128b-4456-9eb1-76442418ea09 in Status: SUCCESS [ 834.028845] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.028845] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.029015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.029203] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.029425] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.029425] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.029568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.029662] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.029820] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.038662] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.038903] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.039056] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.039377] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.039609] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.039873] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-2e582226-fe54-4ca1-b481-4764a5580301" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.532598] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.709157] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 834.709395] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.709623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.709934] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.710418] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.710418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.710418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.710692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.710748] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.710867] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.713019] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 in Status: SUCCESS [ 834.713269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.713790] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.714096] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.714223] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.714329] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.714418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.714656] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.714761] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.714871] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.745570] env[71140]: INFO networking_nsxv3.common.synchronization [req-8bb1ac60-6aea-4fd3-9d13-3fc0cbffe5b8 req-9f487742-b28c-4fe4-a2cd-0c14d02adc6c service nova] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_rules [ 834.745793] env[71140]: INFO networking_nsxv3.common.synchronization [req-8bb1ac60-6aea-4fd3-9d13-3fc0cbffe5b8 req-9f487742-b28c-4fe4-a2cd-0c14d02adc6c service nova] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 834.745966] env[71140]: INFO networking_nsxv3.common.synchronization [req-8bb1ac60-6aea-4fd3-9d13-3fc0cbffe5b8 req-9f487742-b28c-4fe4-a2cd-0c14d02adc6c service nova] Enqueued Resource ID: 2e582226-fe54-4ca1-b481-4764a5580301 with Priority: HIGHEST for action port [ 834.746624] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_rules [ 834.746859] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 834.747677] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e582226-fe54-4ca1-b481-4764a5580301 with Priority: HIGHEST for action port [ 834.748494] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.748668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.748757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.748979] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.749093] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.750137] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.750264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.750468] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e582226-fe54-4ca1-b481-4764a5580301 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.750585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e582226-fe54-4ca1-b481-4764a5580301" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.750681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e582226-fe54-4ca1-b481-4764a5580301" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.750951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e582226-fe54-4ca1-b481-4764a5580301" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.753624] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e582226-fe54-4ca1-b481-4764a5580301',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.861088] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a008c941-3472-43c0-815f-ad4259496329 in Status: SUCCESS [ 834.861275] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a008c941-3472-43c0-815f-ad4259496329 deletion is rescheduled due to dependency. [ 834.861394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.035267] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.218038] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.219045] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.259545] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e582226-fe54-4ca1-b481-4764a5580301 with status ACTIVE [ 835.259818] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.259963] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.260043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.260262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.260356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.260553] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.260651] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.260712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.260860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.260962] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.261139] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.261237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.261299] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.261440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.261513] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.261593] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e582226-fe54-4ca1-b481-4764a5580301 is going to be updated. [ 835.262805] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.262897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.282152] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.282386] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.282467] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.282685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.282826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.283034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e582226-fe54-4ca1-b481-4764a5580301" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.540496] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.540496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.540496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.541060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.541176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.541283] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9ec394c-128b-4456-9eb1-76442418ea09 is going to be updated. [ 835.568777] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.569034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.569140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.569357] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.569501] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.579671] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9ec394c-128b-4456-9eb1-76442418ea09 in Status: IN_PROGRESS for 2s [ 835.720810] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.721799] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.724027] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 835.724175] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 deletion is rescheduled due to dependency. [ 835.724290] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.724510] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.724792] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.724986] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.725159] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.725250] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.725444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.725540] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.725619] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.223626] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.224037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.224037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.224648] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.224648] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.224648] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 is going to be updated. [ 836.225626] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.225770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.225830] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.226030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.226114] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.226213] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 836.227992] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.257171] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.258980] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.259124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.259472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.259631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.261778] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.261911] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.262013] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.262851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.263210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.274625] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 in Status: IN_PROGRESS for 2s [ 836.275515] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 836.734468] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.237514] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.237960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.237960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.238241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.238241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.238346] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be updated. [ 837.266088] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.266288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.266372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.266671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.266768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.274570] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 837.588331] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9ec394c-128b-4456-9eb1-76442418ea09 in Status: SUCCESS [ 837.589115] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.589304] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.589529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.589724] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.589846] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.589918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.590084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.590170] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.590260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.590359] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.018661] env[71140]: INFO networking_nsxv3.common.synchronization [req-d65c5d40-7aad-409b-84da-321e3b152c0b req-654f865d-ccf0-44ac-a97f-5a4d3ce335f0 tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 with Priority: HIGHEST for action security_group_members [ 838.018846] env[71140]: INFO networking_nsxv3.common.synchronization [req-d65c5d40-7aad-409b-84da-321e3b152c0b req-654f865d-ccf0-44ac-a97f-5a4d3ce335f0 tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: f717190f-1b20-4b61-8552-6b8a53fdf07e with Priority: HIGHEST for action security_group_members [ 838.019030] env[71140]: INFO networking_nsxv3.common.synchronization [req-d65c5d40-7aad-409b-84da-321e3b152c0b req-654f865d-ccf0-44ac-a97f-5a4d3ce335f0 tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 838.019717] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 with Priority: HIGHEST for action security_group_members [ 838.019946] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f717190f-1b20-4b61-8552-6b8a53fdf07e with Priority: HIGHEST for action security_group_members [ 838.020017] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 838.020296] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a300b78-a05e-47a1-bd01-b7e39a483342 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.020389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.020567] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f717190f-1b20-4b61-8552-6b8a53fdf07e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.020697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.020759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.021087] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.021256] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.021543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.021543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.021634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.021702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.021791] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f717190f-1b20-4b61-8552-6b8a53fdf07e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.022679] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.022802] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.070110] env[71140]: INFO networking_nsxv3.common.synchronization [req-d65c5d40-7aad-409b-84da-321e3b152c0b req-654f865d-ccf0-44ac-a97f-5a4d3ce335f0 tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 with Priority: HIGHEST for action security_group_rules [ 838.070389] env[71140]: INFO networking_nsxv3.common.synchronization [req-d65c5d40-7aad-409b-84da-321e3b152c0b req-654f865d-ccf0-44ac-a97f-5a4d3ce335f0 tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 with Priority: HIGHEST for action security_group_members [ 838.070666] env[71140]: INFO networking_nsxv3.common.synchronization [req-d65c5d40-7aad-409b-84da-321e3b152c0b req-654f865d-ccf0-44ac-a97f-5a4d3ce335f0 tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_rules [ 838.070789] env[71140]: INFO networking_nsxv3.common.synchronization [req-d65c5d40-7aad-409b-84da-321e3b152c0b req-654f865d-ccf0-44ac-a97f-5a4d3ce335f0 tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 838.070984] env[71140]: INFO networking_nsxv3.common.synchronization [req-d65c5d40-7aad-409b-84da-321e3b152c0b req-654f865d-ccf0-44ac-a97f-5a4d3ce335f0 tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: f717190f-1b20-4b61-8552-6b8a53fdf07e with Priority: HIGHEST for action security_group_rules [ 838.071598] env[71140]: INFO networking_nsxv3.common.synchronization [req-d65c5d40-7aad-409b-84da-321e3b152c0b req-654f865d-ccf0-44ac-a97f-5a4d3ce335f0 tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: f717190f-1b20-4b61-8552-6b8a53fdf07e with Priority: HIGHEST for action security_group_members [ 838.071821] env[71140]: INFO networking_nsxv3.common.synchronization [req-d65c5d40-7aad-409b-84da-321e3b152c0b req-654f865d-ccf0-44ac-a97f-5a4d3ce335f0 tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: b320a11a-f743-474c-bada-ba0ac6f9335f with Priority: HIGHEST for action port [ 838.072496] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 with Priority: HIGHEST for action security_group_rules [ 838.072691] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_rules [ 838.074182] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f717190f-1b20-4b61-8552-6b8a53fdf07e with Priority: HIGHEST for action security_group_members [ 838.074299] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b320a11a-f743-474c-bada-ba0ac6f9335f with Priority: HIGHEST for action port [ 838.074402] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f717190f-1b20-4b61-8552-6b8a53fdf07e with Priority: HIGHEST for action security_group_rules [ 838.074494] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 with Priority: HIGHEST for action security_group_members [ 838.074583] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 838.074899] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a300b78-a05e-47a1-bd01-b7e39a483342 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.075023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.075240] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.075318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.075536] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f717190f-1b20-4b61-8552-6b8a53fdf07e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.075653] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.076678] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-b320a11a-f743-474c-bada-ba0ac6f9335f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.076678] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b320a11a-f743-474c-bada-ba0ac6f9335f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.076678] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b320a11a-f743-474c-bada-ba0ac6f9335f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.076678] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b320a11a-f743-474c-bada-ba0ac6f9335f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.076996] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b320a11a-f743-474c-bada-ba0ac6f9335f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.077742] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f717190f-1b20-4b61-8552-6b8a53fdf07e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.077854] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.077939] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.078188] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.078269] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f717190f-1b20-4b61-8552-6b8a53fdf07e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.079039] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a300b78-a05e-47a1-bd01-b7e39a483342 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.079155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.079357] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.079443] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.096762] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ec394c-128b-4456-9eb1-76442418ea09 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.096762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.096762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.096762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.096762] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.096762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.096762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.096762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.096762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.096762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.098531] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ec394c-128b-4456-9eb1-76442418ea09 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.098531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.098531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.098531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.098531] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.098531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.098531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.098531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.098531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.098531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.098531] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.285197] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 838.285538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.285589] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.285815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.286035] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.286157] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.286224] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.286391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.286612] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.286612] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.286755] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.291454] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 in Status: SUCCESS [ 838.291454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.291454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.291454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.291454] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.291454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.291454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.291454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.291454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.291454] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.291454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.291454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.291454] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.291454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.291454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.292095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.292095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.292095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.292095] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.293046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.293223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.293391] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.293514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.293582] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.293741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.293828] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.293920] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.393994] env[71140]: INFO networking_nsxv3.common.synchronization [req-2811cf00-2a1e-4869-a176-ef80697bf8ab req-a4e8f9a1-fc94-46c3-abb9-0eb94ec976b0 tempest-InstanceActionsV221TestJSON-2040314845 tempest-InstanceActionsV221TestJSON-2040314845-project-member] Enqueued Resource ID: 55e60b37-609d-4b81-9e67-30880d24466d with Priority: HIGHEST for action security_group_members [ 838.394686] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55e60b37-609d-4b81-9e67-30880d24466d with Priority: HIGHEST for action security_group_members [ 838.395427] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-55e60b37-609d-4b81-9e67-30880d24466d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.395622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.395699] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.396029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.396228] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.396343] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.396409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.396591] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.396678] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.396777] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55e60b37-609d-4b81-9e67-30880d24466d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.524210] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f717190f-1b20-4b61-8552-6b8a53fdf07e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.580747] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f717190f-1b20-4b61-8552-6b8a53fdf07e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.581029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.581154] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b320a11a-f743-474c-bada-ba0ac6f9335f with status ACTIVE [ 838.581359] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.581466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.581539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.581762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.581884] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.582093] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.582339] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.582339] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.582489] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.582548] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.582755] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.582843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.582903] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.583092] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.583194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.583283] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b320a11a-f743-474c-bada-ba0ac6f9335f is going to be updated. [ 838.599781] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9ec394c-128b-4456-9eb1-76442418ea09: rpc.has_security_group_logging(os_id): False [ 838.609296] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.609296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.609296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.609296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.609296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.609296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b320a11a-f743-474c-bada-ba0ac6f9335f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.616886] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.617351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.617565] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.617912] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.618170] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.619655] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.619655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.619655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.619655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.619655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.619655] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.619655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.619655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.619655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.620183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.620644] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.620910] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.621220] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.623303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.623303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.623303] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9ec394c-128b-4456-9eb1-76442418ea09 is going to be updated. [ 838.710127] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.710127] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.710127] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.710127] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.710127] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.723569] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9ec394c-128b-4456-9eb1-76442418ea09 in Status: IN_PROGRESS for 2s [ 838.795824] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.795824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.795824] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.796532] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.797279] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.899860] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.899860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.899860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.899860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.899860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.900119] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.900191] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.900248] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.900438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.900542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.900680] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55e60b37-609d-4b81-9e67-30880d24466d already deleted. [ 838.902346] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.955086] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-6 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.955367] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.955443] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.955894] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.956223] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.956453] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.956585] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.956867] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.957049] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.957285] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 838.957400] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 838.957508] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 838.957615] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 838.957724] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 838.957985] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 838.958235] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 838.975463] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 838.975695] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 838.975794] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.975979] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.976389] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-589b3aad-7aac-4828-b184-a5707773cbdf taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.976589] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-589b3aad-7aac-4828-b184-a5707773cbdf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.976714] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-589b3aad-7aac-4828-b184-a5707773cbdf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.977188] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-589b3aad-7aac-4828-b184-a5707773cbdf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.977337] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('589b3aad-7aac-4828-b184-a5707773cbdf',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.027395] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f717190f-1b20-4b61-8552-6b8a53fdf07e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.285260] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 839.285618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.285743] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.286019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.286454] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.286454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.286756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.286756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.286756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.286909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.287030] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.298302] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.299336] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a300b78-a05e-47a1-bd01-b7e39a483342: rpc.has_security_group_logging(os_id): False [ 839.300538] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.317977] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.318114] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.318187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.318607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.318607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.318779] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.318880] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.318880] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.319064] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.319210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.319244] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 is going to be created. [ 839.368347] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.368501] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.368574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.368833] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.368954] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.381174] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 in Status: IN_PROGRESS for 2s [ 839.482048] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.482900] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.482997] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.483516] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.483789] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.484460] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 589b3aad-7aac-4828-b184-a5707773cbdf not found, creating... [ 839.484792] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.485360] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.485904] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.486246] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.486463] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.486854] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.487035] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.487165] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.487397] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.487539] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.487686] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 589b3aad-7aac-4828-b184-a5707773cbdf is going to be created. [ 839.511443] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.512304] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.512304] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.512304] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.512512] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.513528] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-589b3aad-7aac-4828-b184-a5707773cbdf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.532670] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.532670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.532670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.532670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.532670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.532670] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f717190f-1b20-4b61-8552-6b8a53fdf07e is going to be created. [ 839.557440] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.557630] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.557664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.557921] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.558028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.569598] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f717190f-1b20-4b61-8552-6b8a53fdf07e in Status: UNINITIALIZED for 2s [ 839.789518] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.789716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.789794] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.790067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.790309] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.790378] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.790441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.790605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.790696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.790824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.790991] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.791113] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.791113] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.791583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.791583] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.791583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.791583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.791768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.791768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.791836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.791966] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.800700] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.800840] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.800905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.801151] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.801257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.801367] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 839.803314] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.803434] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.803502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.803693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.803808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.803905] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 is going to be updated. [ 839.862292] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.862464] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.862543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.862771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.862920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.867717] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.867717] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.867717] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.867717] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.867717] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.875450] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 839.879444] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 in Status: IN_PROGRESS for 2s [ 840.295410] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c549bd3-468a-4655-b709-3480ff374e11: rpc.has_security_group_logging(os_id): False [ 840.316868] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.316868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.316868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.316868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.316868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.316868] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.316868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.316868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.316868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.316868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.316868] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.316868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.316868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.317520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.317520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.317520] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.318389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.318594] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.318843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.320500] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.320500] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be updated. [ 840.350219] env[71140]: INFO networking_nsxv3.common.synchronization [req-2811cf00-2a1e-4869-a176-ef80697bf8ab req-eefdb9d8-64c9-4ab8-af04-4d60f219c304 service nova] Enqueued Resource ID: 55e60b37-609d-4b81-9e67-30880d24466d with Priority: HIGHEST for action security_group_rules [ 840.350219] env[71140]: INFO networking_nsxv3.common.synchronization [req-2811cf00-2a1e-4869-a176-ef80697bf8ab req-eefdb9d8-64c9-4ab8-af04-4d60f219c304 service nova] Enqueued Resource ID: 55e60b37-609d-4b81-9e67-30880d24466d with Priority: HIGHEST for action security_group_members [ 840.350219] env[71140]: INFO networking_nsxv3.common.synchronization [req-2811cf00-2a1e-4869-a176-ef80697bf8ab req-eefdb9d8-64c9-4ab8-af04-4d60f219c304 service nova] Enqueued Resource ID: 589b3aad-7aac-4828-b184-a5707773cbdf with Priority: HIGHEST for action port [ 840.350219] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55e60b37-609d-4b81-9e67-30880d24466d with Priority: HIGHEST for action security_group_rules [ 840.350219] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55e60b37-609d-4b81-9e67-30880d24466d with Priority: HIGHEST for action security_group_members [ 840.350219] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 589b3aad-7aac-4828-b184-a5707773cbdf with Priority: HIGHEST for action port [ 840.351112] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55e60b37-609d-4b81-9e67-30880d24466d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.351492] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.351935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.355156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.355156] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55e60b37-609d-4b81-9e67-30880d24466d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.355156] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-55e60b37-609d-4b81-9e67-30880d24466d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.355156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.355156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.355156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.355156] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.355156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.355156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.355156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.355156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.355156] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55e60b37-609d-4b81-9e67-30880d24466d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.358626] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-589b3aad-7aac-4828-b184-a5707773cbdf taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.358626] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-589b3aad-7aac-4828-b184-a5707773cbdf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.358626] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-589b3aad-7aac-4828-b184-a5707773cbdf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.358626] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-589b3aad-7aac-4828-b184-a5707773cbdf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.358626] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('589b3aad-7aac-4828-b184-a5707773cbdf',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.376695] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.376695] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.376695] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.376695] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.376695] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.394488] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 840.696253] env[71140]: INFO networking_nsxv3.common.synchronization [req-075494fd-773d-4258-9a00-9446f4a2e536 req-c7e5f47e-0d91-4d0b-826a-742bb3983427 tempest-ImagesTestJSON-1376189349 tempest-ImagesTestJSON-1376189349-project-member] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 840.697134] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 840.697203] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.697321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.697430] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.697663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.697839] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.697947] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.698023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.698181] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.698271] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.698363] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.735852] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9ec394c-128b-4456-9eb1-76442418ea09 in Status: SUCCESS [ 840.736110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.859742] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-55e60b37-609d-4b81-9e67-30880d24466d taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.859921] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.861750] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 589b3aad-7aac-4828-b184-a5707773cbdf with status ACTIVE [ 840.861750] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.861750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.861750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.862406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.862406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.862406] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.862577] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.862577] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.862675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.862755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.862944] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.863134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.863134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.863224] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.863305] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.863466] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 589b3aad-7aac-4828-b184-a5707773cbdf is going to be updated. [ 840.864487] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55e60b37-609d-4b81-9e67-30880d24466d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.884311] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.884523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.884637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.884881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.885033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.885203] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-589b3aad-7aac-4828-b184-a5707773cbdf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.201574] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.201740] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.202344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.202344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.203057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.203150] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.203284] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.203353] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.204805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.204805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.204805] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be updated. [ 841.234591] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.234754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.234809] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.235028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.235210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.254454] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 841.367084] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55e60b37-609d-4b81-9e67-30880d24466d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.402703] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 in Status: SUCCESS [ 841.402928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.403149] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.403373] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.403462] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.579537] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f717190f-1b20-4b61-8552-6b8a53fdf07e in Status: SUCCESS [ 841.579845] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.580101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.580240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.580440] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.580568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.580634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.580801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.580891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.581130] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f717190f-1b20-4b61-8552-6b8a53fdf07e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.869831] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.870015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.870530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.870530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.870530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.870766] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55e60b37-609d-4b81-9e67-30880d24466d is going to be created. [ 841.886225] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 841.886437] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.887341] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 in Status: SUCCESS [ 841.887569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.887752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.887988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.888282] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.888472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.888592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.888842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.888976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.889241] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.890434] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.890720] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.891302] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.891302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.891425] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.891661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.891794] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.891934] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.896979] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.897725] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.897725] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.897914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.898149] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.907147] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a300b78-a05e-47a1-bd01-b7e39a483342 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.907291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.909026] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55e60b37-609d-4b81-9e67-30880d24466d in Status: UNINITIALIZED for 2s [ 842.085420] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f717190f-1b20-4b61-8552-6b8a53fdf07e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.316803] env[71140]: INFO networking_nsxv3.common.synchronization [req-3fe5c794-21ca-4979-a67e-400d048c8b7c req-a83992d4-f2f0-4e7e-b91c-355f72482692 tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 with Priority: HIGHEST for action security_group_members [ 842.317684] env[71140]: INFO networking_nsxv3.common.synchronization [req-3fe5c794-21ca-4979-a67e-400d048c8b7c req-a83992d4-f2f0-4e7e-b91c-355f72482692 tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 842.317684] env[71140]: INFO networking_nsxv3.common.synchronization [req-3fe5c794-21ca-4979-a67e-400d048c8b7c req-a83992d4-f2f0-4e7e-b91c-355f72482692 tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: f717190f-1b20-4b61-8552-6b8a53fdf07e with Priority: HIGHEST for action security_group_members [ 842.317922] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 with Priority: HIGHEST for action security_group_members [ 842.318201] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 842.318201] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f717190f-1b20-4b61-8552-6b8a53fdf07e with Priority: HIGHEST for action security_group_members [ 842.318495] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a300b78-a05e-47a1-bd01-b7e39a483342 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.318605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.318813] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.318911] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.319197] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f717190f-1b20-4b61-8552-6b8a53fdf07e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.319297] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.394577] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.395408] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.409954] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 842.410214] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.587750] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f717190f-1b20-4b61-8552-6b8a53fdf07e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.902474] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.902474] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.091734] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.091897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.091972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.092229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.092341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.092471] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f717190f-1b20-4b61-8552-6b8a53fdf07e is going to be updated. [ 843.121030] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.121030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.121030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.121030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.121030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.128810] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f717190f-1b20-4b61-8552-6b8a53fdf07e in Status: IN_PROGRESS for 2s [ 843.263222] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 843.263429] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 deletion is rescheduled due to dependency. [ 843.263542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.405445] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.405776] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.405776] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.406011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.406118] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.406278] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 843.407541] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.407659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.407761] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.407911] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.407996] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.408110] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 is going to be updated. [ 843.455853] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.457046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.457046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.457046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.457046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.462535] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.462535] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.462535] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.462535] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.462535] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.472592] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 in Status: IN_PROGRESS for 2s [ 843.473313] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 843.918865] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55e60b37-609d-4b81-9e67-30880d24466d in Status: SUCCESS [ 843.918865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.918865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.918865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.918865] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.918865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.918865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.918865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.919240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.919240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.919240] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55e60b37-609d-4b81-9e67-30880d24466d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.307274] env[71140]: INFO networking_nsxv3.common.synchronization [req-bb0ab7d0-223c-4e54-8229-97f663abb0d6 req-6e118739-842c-4429-92cb-8e6a5c8a969c tempest-ServerRescueNegativeTestJSON-432250818 tempest-ServerRescueNegativeTestJSON-432250818-project-member] Enqueued Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGHEST for action security_group_members [ 844.307874] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGHEST for action security_group_members [ 844.308232] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.308393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.308473] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.308764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.308956] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.309115] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.309191] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.309389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.309505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.309624] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.422068] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-55e60b37-609d-4b81-9e67-30880d24466d taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.422564] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.422564] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.422996] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.423333] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.423506] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.423588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.423892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.424514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.424514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.424514] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-55e60b37-609d-4b81-9e67-30880d24466d taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.424807] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.424807] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.424910] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.425135] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.425314] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.425425] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.425689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.425848] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.426118] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.426278] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55e60b37-609d-4b81-9e67-30880d24466d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.812799] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.813019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.813081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.813300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.813397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.813609] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.813705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.813767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.813913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.814024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.814077] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 already deleted. [ 844.814161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.928679] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55e60b37-609d-4b81-9e67-30880d24466d: rpc.has_security_group_logging(os_id): False [ 844.944133] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-99 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.944389] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.944523] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.944846] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.945123] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.945280] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.948075] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.948075] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.948075] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.948075] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.948075] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.948075] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.948075] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.948075] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.948075] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.948075] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.949099] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.949099] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.949262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.949412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.949495] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.949656] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.949744] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.949815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.949962] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.950053] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.950238] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.950331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.950392] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.950531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.950615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.950813] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.950907] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.950970] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.951160] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.951240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.951327] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55e60b37-609d-4b81-9e67-30880d24466d is going to be created. [ 844.976976] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.977182] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 844.977323] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.977500] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.977901] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-8f581917-2264-4a54-86ad-fab596aaf698 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.978150] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-8f581917-2264-4a54-86ad-fab596aaf698" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.978327] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-8f581917-2264-4a54-86ad-fab596aaf698" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.978584] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-8f581917-2264-4a54-86ad-fab596aaf698" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.978732] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f581917-2264-4a54-86ad-fab596aaf698',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.018730] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.018888] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.018962] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.019192] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.019365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.029495] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55e60b37-609d-4b81-9e67-30880d24466d in Status: IN_PROGRESS for 2s [ 845.141096] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f717190f-1b20-4b61-8552-6b8a53fdf07e in Status: SUCCESS [ 845.141349] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.141508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.141727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.141916] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.142048] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.142117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.142277] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.142359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.142440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.142536] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f717190f-1b20-4b61-8552-6b8a53fdf07e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.143367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.143535] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.143691] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.143830] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.143920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.145340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.145469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.145593] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f717190f-1b20-4b61-8552-6b8a53fdf07e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.482942] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 in Status: SUCCESS [ 845.483356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.483356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.483573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.483774] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.483913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.483984] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.484115] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.484198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.484280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.484381] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.489024] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 845.489024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.489024] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.489024] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.489024] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.489024] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.489024] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.489024] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 8f581917-2264-4a54-86ad-fab596aaf698 not found, creating... [ 845.489024] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.489024] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.489851] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.489851] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.489851] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.489851] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.490127] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.490127] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.490917] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.490917] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.490917] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 8f581917-2264-4a54-86ad-fab596aaf698 is going to be created. [ 845.492694] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.492875] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.493039] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.493144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.493207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.493339] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.493444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.493547] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.494425] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.494588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.494745] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.494875] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.494980] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.495877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.495985] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.496093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.497021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.497021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.497021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.497021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.497021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.497021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.497021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.497021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.497021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.498858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.498858] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.498858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.498858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.499059] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.499120] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.499156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.499567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.499686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.499763] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.529344] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.529344] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.529344] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.529344] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.529344] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.529344] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-8f581917-2264-4a54-86ad-fab596aaf698" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.651140] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f717190f-1b20-4b61-8552-6b8a53fdf07e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.651140] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.651140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.651140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.651140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.651140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.651140] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.651140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.651140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.651140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.651140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.651140] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f717190f-1b20-4b61-8552-6b8a53fdf07e is going to be deleted. [ 845.718800] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.718800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.718800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.718800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.718800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.718800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.003204] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a300b78-a05e-47a1-bd01-b7e39a483342',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.003204] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.003204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.003204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.003204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.003204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.003204] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.003204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.003204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.003204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.003204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.003204] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 is going to be updated. [ 846.005361] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470: rpc.has_security_group_logging(os_id): False [ 846.007261] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.027511] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.030028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.030028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.030028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.030028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.030028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.030028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.030028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.030028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.030028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.030028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.030028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.030028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.030028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.030028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.030598] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.030598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.030598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.030598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.030598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.030908] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 846.034187] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.034869] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.035100] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.035397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.035647] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.043886] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 in Status: IN_PROGRESS for 2s [ 846.101026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.101026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.101026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.101026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.101026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.131039] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 846.155701] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f717190f-1b20-4b61-8552-6b8a53fdf07e: rpc.has_security_group_logging(os_id): False [ 846.182918] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.183266] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.183550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.183901] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.184998] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.184998] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.184998] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.184998] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.184998] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.185684] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.185803] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f717190f-1b20-4b61-8552-6b8a53fdf07e is going to be created. [ 846.218036] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/f717190f-1b20-4b61-8552-6b8a53fdf07e], does not exist path=[/infra/domains/default/groups/f717190f-1b20-4b61-8552-6b8a53fdf07e]."\n}' [ 846.218036] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f717190f-1b20-4b61-8552-6b8a53fdf07e failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f717190f-1b20-4b61-8552-6b8a53fdf07e [ 846.218036] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 846.273090] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.273249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.273322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.273536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.274901] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.275205] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.275354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.275403] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.275543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.275624] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.275820] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.275935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.275972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.276116] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.276229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.276266] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f717190f-1b20-4b61-8552-6b8a53fdf07e is going to be created. [ 846.306024] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/f717190f-1b20-4b61-8552-6b8a53fdf07e], does not exist path=[/infra/domains/default/groups/f717190f-1b20-4b61-8552-6b8a53fdf07e]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f717190f-1b20-4b61-8552-6b8a53fdf07e [ 846.306024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f717190f-1b20-4b61-8552-6b8a53fdf07e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.306024] env[71140]: Traceback (most recent call last): [ 846.306024] env[71140]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 846.306024] env[71140]: return func(*args, **kwargs) [ 846.306024] env[71140]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 846.306024] env[71140]: res.raise_for_status() [ 846.306024] env[71140]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 846.306024] env[71140]: raise HTTPError(http_error_msg, response=self) [ 846.306024] env[71140]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f717190f-1b20-4b61-8552-6b8a53fdf07e [ 846.306024] env[71140]: During handling of the above exception, another exception occurred: [ 846.306024] env[71140]: Traceback (most recent call last): [ 846.306024] env[71140]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 846.306024] env[71140]: listener.cb(fileno) [ 846.306024] env[71140]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 846.306024] env[71140]: result = function(*args, **kwargs) [ 846.306024] env[71140]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 846.306024] env[71140]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 846.306024] env[71140]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 846.306024] env[71140]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 846.306024] env[71140]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 846.306024] env[71140]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 846.306024] env[71140]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 846.306024] env[71140]: res.raise_for_status() [ 846.306024] env[71140]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 846.306024] env[71140]: raise HTTPError(http_error_msg, response=self) [ 846.306024] env[71140]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f717190f-1b20-4b61-8552-6b8a53fdf07e [ 846.306024] env[71140]: Removing descriptor: 5 [ 846.336352] env[71140]: INFO networking_nsxv3.common.synchronization [req-bb0ab7d0-223c-4e54-8229-97f663abb0d6 req-a4d8bd31-02cb-47da-aa4f-1a3431932ecb service nova] Enqueued Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGHEST for action security_group_rules [ 846.336352] env[71140]: INFO networking_nsxv3.common.synchronization [req-bb0ab7d0-223c-4e54-8229-97f663abb0d6 req-a4d8bd31-02cb-47da-aa4f-1a3431932ecb service nova] Enqueued Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGHEST for action security_group_members [ 846.336352] env[71140]: INFO networking_nsxv3.common.synchronization [req-bb0ab7d0-223c-4e54-8229-97f663abb0d6 req-a4d8bd31-02cb-47da-aa4f-1a3431932ecb service nova] Enqueued Resource ID: 8f581917-2264-4a54-86ad-fab596aaf698 with Priority: HIGHEST for action port [ 846.336352] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGHEST for action security_group_rules [ 846.336352] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGHEST for action security_group_members [ 846.336352] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f581917-2264-4a54-86ad-fab596aaf698 with Priority: HIGHEST for action port [ 846.336352] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.336352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.336352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.336352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.336352] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.337111] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.337111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.337111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.337212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.337378] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.337487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.337547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.337691] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.337774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.337891] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.338973] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f581917-2264-4a54-86ad-fab596aaf698 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.338973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f581917-2264-4a54-86ad-fab596aaf698" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.339160] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f581917-2264-4a54-86ad-fab596aaf698" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.339211] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f581917-2264-4a54-86ad-fab596aaf698" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.339300] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f581917-2264-4a54-86ad-fab596aaf698',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.506411] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a300b78-a05e-47a1-bd01-b7e39a483342: rpc.has_security_group_logging(os_id): False [ 846.512154] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.528124] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.528236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.528361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.528484] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.547244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.547593] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.547731] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.547809] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.548042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.548150] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.548246] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 is going to be updated. [ 846.597412] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.598825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.598825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.598825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.598825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.609404] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 in Status: IN_PROGRESS for 2s [ 846.840526] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.841673] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.841818] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.842096] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f581917-2264-4a54-86ad-fab596aaf698 with status ACTIVE [ 846.842266] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.842386] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.842460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.842669] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.842757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.842920] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.843030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.843095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.843280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.843362] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.843545] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.843631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.843689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.843842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.843900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.843986] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f581917-2264-4a54-86ad-fab596aaf698 is going to be updated. [ 846.864670] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.864810] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.864883] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.865139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.865289] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.865453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f581917-2264-4a54-86ad-fab596aaf698" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.014683] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.014967] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.015058] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.015283] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.015390] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.015491] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 847.041352] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55e60b37-609d-4b81-9e67-30880d24466d in Status: SUCCESS [ 847.041669] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.043910] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.044089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.044169] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.044389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.044537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.051632] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 847.198254] env[71140]: INFO networking_nsxv3.common.synchronization [req-55170816-dd2e-46e0-8df9-fcf835608a55 req-3bcd8dd3-131f-4487-b9a9-ed2186cded0d tempest-ServerRescueNegativeTestJSON-432250818 tempest-ServerRescueNegativeTestJSON-432250818-project-member] Enqueued Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGHEST for action security_group_members [ 847.198861] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGHEST for action security_group_members [ 847.199215] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.199351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.344242] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.791148] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-99 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.791466] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.791466] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.791725] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.791976] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.792151] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.792262] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.792535] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.792691] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.793243] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.793243] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.793243] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.793371] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.793425] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.793533] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.793666] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.812623] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.812799] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 847.812918] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.814928] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.814928] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-f6fd0111-1afc-4f4f-80bb-de814053a257 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.814928] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-f6fd0111-1afc-4f4f-80bb-de814053a257" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.814928] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-f6fd0111-1afc-4f4f-80bb-de814053a257" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.814928] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-f6fd0111-1afc-4f4f-80bb-de814053a257" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.814928] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6fd0111-1afc-4f4f-80bb-de814053a257',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.845454] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.845719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.845768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.846101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.846224] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.846330] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 is going to be created. [ 847.867112] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.867248] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.867315] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.867560] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.867729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.876436] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 in Status: UNINITIALIZED for 2s [ 848.053419] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 in Status: SUCCESS [ 848.053419] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 deletion is rescheduled due to dependency. [ 848.053419] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.148610] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 848.148918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.149257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.149753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.149753] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.317093] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.317456] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.317676] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.318110] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.318322] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.318566] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port f6fd0111-1afc-4f4f-80bb-de814053a257 not found, creating... [ 848.319011] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.319274] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.319465] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.319807] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.320060] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.320540] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.321019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.321019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.321270] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.321436] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.321614] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: f6fd0111-1afc-4f4f-80bb-de814053a257 is going to be created. [ 848.341023] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.341023] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.341023] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.341023] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.341388] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.341388] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-f6fd0111-1afc-4f4f-80bb-de814053a257" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.621862] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a300b78-a05e-47a1-bd01-b7e39a483342 in Status: SUCCESS [ 848.622103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a300b78-a05e-47a1-bd01-b7e39a483342" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.653048] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.653144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.069490] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 849.069490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.069490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.069490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.069490] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.069490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.069490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.069490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.069490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.069490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.069490] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.269025] env[71140]: INFO networking_nsxv3.common.synchronization [req-55170816-dd2e-46e0-8df9-fcf835608a55 req-8cc901ae-9c19-4f7f-a515-f33004533a85 service nova] Enqueued Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGHEST for action security_group_rules [ 849.269025] env[71140]: INFO networking_nsxv3.common.synchronization [req-55170816-dd2e-46e0-8df9-fcf835608a55 req-8cc901ae-9c19-4f7f-a515-f33004533a85 service nova] Enqueued Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGHEST for action security_group_members [ 849.269025] env[71140]: INFO networking_nsxv3.common.synchronization [req-55170816-dd2e-46e0-8df9-fcf835608a55 req-8cc901ae-9c19-4f7f-a515-f33004533a85 service nova] Enqueued Resource ID: f6fd0111-1afc-4f4f-80bb-de814053a257 with Priority: HIGHEST for action port [ 849.269025] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGHEST for action security_group_rules [ 849.269305] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGHEST for action security_group_members [ 849.269305] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6fd0111-1afc-4f4f-80bb-de814053a257 with Priority: HIGHEST for action port [ 849.269562] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.269671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.269869] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.269956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.270268] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6fd0111-1afc-4f4f-80bb-de814053a257 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.270268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6fd0111-1afc-4f4f-80bb-de814053a257" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.270393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6fd0111-1afc-4f4f-80bb-de814053a257" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.270510] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6fd0111-1afc-4f4f-80bb-de814053a257" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.270597] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6fd0111-1afc-4f4f-80bb-de814053a257',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.573806] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.574024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.574125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.574260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.574441] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.574538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.574598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.574737] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.574873] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.574984] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.575410] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.575410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.575410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.575735] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.575735] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.575860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.575860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.576676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.576676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.576676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.576676] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.773843] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6fd0111-1afc-4f4f-80bb-de814053a257 with status ACTIVE [ 849.774070] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.774226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.774298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.774513] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.774606] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.774777] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.775022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.775109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.775304] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.775391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.775801] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.775801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.775949] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.776631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.776631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.776631] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6fd0111-1afc-4f4f-80bb-de814053a257 is going to be updated. [ 849.799327] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.799430] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.799516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.799696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.799861] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.800063] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6fd0111-1afc-4f4f-80bb-de814053a257" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.832858] env[71140]: INFO networking_nsxv3.common.synchronization [req-68053c90-4a94-4f2c-b16d-4003b763ec2d req-cbc62a92-feec-4642-9204-d89be133fedc tempest-ImagesOneServerNegativeTestJSON-512607698 tempest-ImagesOneServerNegativeTestJSON-512607698-project-member] Enqueued Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 849.833408] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 849.833705] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.833821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.833887] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.834094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.834243] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.834396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.834396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.834551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.834629] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.834698] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.886400] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 in Status: SUCCESS [ 849.886630] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.886805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.889021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.889021] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.889541] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.889541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.889541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.889541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.889541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.889773] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.078794] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470: rpc.has_security_group_logging(os_id): False [ 850.102063] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.104324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.104324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.104324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.124766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.127782] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.127782] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.127782] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.127782] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.127782] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.127782] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.127782] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.127782] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.127782] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.127782] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.127782] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.129207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.129862] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.130527] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.132869] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.132869] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 850.206039] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.206039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.206039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.206039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.206039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.220852] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 850.340470] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.340470] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.340470] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.340470] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.363588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.363588] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.363588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.363588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.363588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.363588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.363588] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 is going to be updated. [ 850.392585] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.392585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.392585] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.402469] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.402469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.402469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.402469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.402469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.412955] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: IN_PROGRESS for 2s [ 850.537786] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.537786] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-173" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.538021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-173" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.538295] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-173" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.539017] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.539432] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.539664] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.541673] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.542057] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.542383] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 850.542710] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.543016] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.543223] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.543431] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 850.543654] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.543879] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.562941] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.564621] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 850.564839] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.564996] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-173" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.565374] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-03faaf87-967d-43f2-a48c-ac321fd40d59 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.565591] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-03faaf87-967d-43f2-a48c-ac321fd40d59" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.566450] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-03faaf87-967d-43f2-a48c-ac321fd40d59" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.566976] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-03faaf87-967d-43f2-a48c-ac321fd40d59" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.566976] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03faaf87-967d-43f2-a48c-ac321fd40d59',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.894612] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.070358] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.070691] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.070909] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.071370] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.071619] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.071883] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 03faaf87-967d-43f2-a48c-ac321fd40d59 not found, creating... [ 851.072320] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.072427] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.072542] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.072893] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.073106] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.073452] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.073613] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.073734] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.073985] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.074189] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.074384] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 03faaf87-967d-43f2-a48c-ac321fd40d59 is going to be created. [ 851.094491] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.094938] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.094938] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.095202] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.095427] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.095871] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-03faaf87-967d-43f2-a48c-ac321fd40d59" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.397054] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.397180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.397314] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.397585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.397665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.397764] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 is going to be updated. [ 851.411235] env[71140]: INFO networking_nsxv3.common.synchronization [req-fa745b23-7bd3-4584-ab72-d7492b18c4b2 req-8d429989-c64b-4516-9b8c-0b6b455ef6a4 tempest-ServersWithSpecificFlavorTestJSON-1339181312 tempest-ServersWithSpecificFlavorTestJSON-1339181312-project-member] Enqueued Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_members [ 851.411797] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_members [ 851.412155] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62a92b8-4863-4e9d-809d-e8687b429f2a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.412280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.412913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.412913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.412913] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.412913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.412913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.413199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.414160] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.414258] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.437696] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.437848] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.437921] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.438155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.438294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.448738] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 in Status: IN_PROGRESS for 2s [ 851.919776] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.919776] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.919776] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.919776] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.941674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.941674] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.941674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.941674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.941674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.941674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.941674] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c62a92b8-4863-4e9d-809d-e8687b429f2a is going to be updated. [ 851.965648] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.965648] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.965648] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.965648] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.965648] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.973132] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62a92b8-4863-4e9d-809d-e8687b429f2a in Status: IN_PROGRESS for 2s [ 852.241982] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 852.241982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.275021] env[71140]: INFO networking_nsxv3.common.synchronization [req-68053c90-4a94-4f2c-b16d-4003b763ec2d req-88c83b7e-114a-4369-a7af-7eaf89e2acec service nova] Enqueued Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_rules [ 852.275021] env[71140]: INFO networking_nsxv3.common.synchronization [req-68053c90-4a94-4f2c-b16d-4003b763ec2d req-88c83b7e-114a-4369-a7af-7eaf89e2acec service nova] Enqueued Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 852.275021] env[71140]: INFO networking_nsxv3.common.synchronization [req-68053c90-4a94-4f2c-b16d-4003b763ec2d req-88c83b7e-114a-4369-a7af-7eaf89e2acec service nova] Enqueued Resource ID: 03faaf87-967d-43f2-a48c-ac321fd40d59 with Priority: HIGHEST for action port [ 852.275021] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_rules [ 852.275021] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 852.275021] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03faaf87-967d-43f2-a48c-ac321fd40d59 with Priority: HIGHEST for action port [ 852.275021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.275021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.275021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.275021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.275021] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.275559] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.275559] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.275730] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-03faaf87-967d-43f2-a48c-ac321fd40d59 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.275831] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03faaf87-967d-43f2-a48c-ac321fd40d59" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.275897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03faaf87-967d-43f2-a48c-ac321fd40d59" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.276086] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03faaf87-967d-43f2-a48c-ac321fd40d59" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.276164] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03faaf87-967d-43f2-a48c-ac321fd40d59',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.424134] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: SUCCESS [ 852.424134] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 deletion is rescheduled due to dependency. [ 852.424134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.424576] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.426019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.426019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.426019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.426019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.426019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.426019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.426019] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.501473] env[71140]: INFO networking_nsxv3.common.synchronization [req-4939b45b-b1f0-4ba4-ba88-0114dd8988d7 req-40b8102f-48a8-4d2f-a4a3-b999a19d3aae tempest-FloatingIPsAssociationTestJSON-945479351 tempest-FloatingIPsAssociationTestJSON-945479351-project-member] Enqueued Resource ID: f9ec394c-128b-4456-9eb1-76442418ea09 with Priority: HIGHEST for action security_group_members [ 852.501941] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ec394c-128b-4456-9eb1-76442418ea09 with Priority: HIGHEST for action security_group_members [ 852.502368] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ec394c-128b-4456-9eb1-76442418ea09 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.502517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.502583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.502814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.502933] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.503854] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.504056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.504177] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.504279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.504400] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.512387] env[71140]: INFO networking_nsxv3.common.synchronization [req-292aa75e-61b3-4e0d-bb05-60e0519bb721 req-b32c77f0-316d-452a-90f7-34f99f405ae0 tempest-InstanceActionsV221TestJSON-2040314845 tempest-InstanceActionsV221TestJSON-2040314845-project-member] Enqueued Resource ID: 55e60b37-609d-4b81-9e67-30880d24466d with Priority: HIGHEST for action security_group_members [ 852.512908] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55e60b37-609d-4b81-9e67-30880d24466d with Priority: HIGHEST for action security_group_members [ 852.513225] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-55e60b37-609d-4b81-9e67-30880d24466d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.513345] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.513410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.513691] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.513754] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.515261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.515261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.515261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.515261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.515261] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55e60b37-609d-4b81-9e67-30880d24466d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.778158] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.778294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.778473] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03faaf87-967d-43f2-a48c-ac321fd40d59 with status ACTIVE [ 852.778642] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.778813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.778864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.782020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.782020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.782020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.782020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.782020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.782020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.782020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.782020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.782020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.782020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.782020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.782020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.782020] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03faaf87-967d-43f2-a48c-ac321fd40d59 is going to be updated. [ 852.804031] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.804031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.804031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.804252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.804390] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.804550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03faaf87-967d-43f2-a48c-ac321fd40d59" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.928164] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.006938] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.016629] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.016790] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.016897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.017113] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.037194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.037450] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.037569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.037637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.037837] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.037966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.038038] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55e60b37-609d-4b81-9e67-30880d24466d is going to be updated. [ 853.062802] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.063086] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.063086] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.063560] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.064611] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.073235] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55e60b37-609d-4b81-9e67-30880d24466d in Status: IN_PROGRESS for 2s [ 853.430214] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.460111] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 in Status: SUCCESS [ 853.460333] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.460494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.460825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.460996] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.461234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.461345] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.461543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.461656] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.461801] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.510436] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.933243] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.933464] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.933588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.933831] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.933956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.934078] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 is going to be updated. [ 853.962946] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.963104] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.963204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.963408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.963510] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.964574] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.972931] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: IN_PROGRESS for 2s [ 853.980737] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62a92b8-4863-4e9d-809d-e8687b429f2a in Status: SUCCESS [ 853.980915] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c62a92b8-4863-4e9d-809d-e8687b429f2a deletion is rescheduled due to dependency. [ 853.981048] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.014838] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.014838] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.014838] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.014838] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.014838] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.014838] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9ec394c-128b-4456-9eb1-76442418ea09 is going to be updated. [ 854.056220] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.057155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.057155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.057155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.057155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.066457] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9ec394c-128b-4456-9eb1-76442418ea09 in Status: IN_PROGRESS for 2s [ 854.467531] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.972508] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.972671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.972749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.972999] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.973051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.973191] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 is going to be updated. [ 855.017361] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.017557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.017557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.017771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.017994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.029753] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 in Status: IN_PROGRESS for 2s [ 855.081759] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55e60b37-609d-4b81-9e67-30880d24466d in Status: SUCCESS [ 855.081961] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55e60b37-609d-4b81-9e67-30880d24466d deletion is rescheduled due to dependency. [ 855.082095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.983150] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: SUCCESS [ 855.983437] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.983674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.983751] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.983934] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.984065] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.984133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.984286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.984371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.984457] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.984545] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.074752] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9ec394c-128b-4456-9eb1-76442418ea09 in Status: SUCCESS [ 856.074973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.107942] env[71140]: INFO networking_nsxv3.common.synchronization [req-027d29b3-c660-425d-ba32-4e85975e7c40 req-62a8f5f9-b3a1-413f-8282-6fed8df8045c tempest-ServersAdminTestJSON-2080308680 tempest-ServersAdminTestJSON-2080308680-project-member] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 856.108518] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 856.108816] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.108940] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.109016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.109242] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.109398] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.109732] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.109732] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.109732] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.109871] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.109871] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.486571] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.486682] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.486736] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.487705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.487705] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.487705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.487705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.487938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.487985] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.488082] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.488241] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.488346] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.488418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.488581] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.489191] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.489294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.489359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.489509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.489587] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.489700] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.489845] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.612098] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.991803] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1100ce56-f855-47e4-96bb-f4bbe37e7632: rpc.has_security_group_logging(os_id): False [ 857.009682] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.009912] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.009912] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.011359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.011359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.011359] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.011359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.011359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.011359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.012564] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.013256] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.013539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.013734] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.014053] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.014193] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.014879] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.014879] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.015122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.015356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.015475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.015620] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 is going to be updated. [ 857.038433] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 in Status: SUCCESS [ 857.038632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.038793] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.038995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.039201] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.039325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.039387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.039537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.039614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.039696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.039853] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.039942] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.040018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.040160] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.040296] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.040383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.040442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.040574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.040644] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.040721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.040807] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.076023] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.076023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.076023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.076023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.076023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.088945] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: IN_PROGRESS for 2s [ 857.119914] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.335663] env[71140]: INFO networking_nsxv3.common.synchronization [req-503983c4-fdb6-446b-a211-03697944678b req-d90c1130-a951-4822-9796-d2a82f76bad0 tempest-VolumesAssistedSnapshotsTest-1122912751 tempest-VolumesAssistedSnapshotsTest-1122912751-project-member] Enqueued Resource ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 with Priority: HIGHEST for action security_group_members [ 857.335921] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 with Priority: HIGHEST for action security_group_members [ 857.336261] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1516d35-770d-4ac2-bf00-b0eed6f837f7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.336380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.336454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.336638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.336841] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.336994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.337971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.337971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.337971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.337971] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1516d35-770d-4ac2-bf00-b0eed6f837f7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.545472] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30ff0c23-f932-4ef1-8e47-6bf1171fa339: rpc.has_security_group_logging(os_id): False [ 857.563919] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.563919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.563919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.563919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.563919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.564204] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.564204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.564204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.564359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.565024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.565024] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.565024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.565024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.565024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.565024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.565422] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.565422] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.565422] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.565546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.565546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.565611] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 is going to be created. [ 857.623791] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.623968] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.623968] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.624805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.624805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.625590] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.625814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.625814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.625936] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.626035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.626142] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be updated. [ 857.661988] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 in Status: IN_PROGRESS for 2s [ 857.678219] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.678332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.678421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.678649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.678796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.697131] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: IN_PROGRESS for 2s [ 857.839611] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.839771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.840068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.840068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.863035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.863035] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.863035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.863035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.863252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.863350] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.863405] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 is going to be updated. [ 857.865453] env[71140]: INFO networking_nsxv3.common.synchronization [req-73c52080-71ea-402d-8250-7270c292c9c8 req-9e1fedcf-3ac6-4e70-aaef-75d26665bd9e tempest-ServerDiskConfigTestJSON-63292790 tempest-ServerDiskConfigTestJSON-63292790-project-member] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 857.869466] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 857.869466] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.869466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.869466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.869466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.869466] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.869466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.869466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.869466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.869466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.869466] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.911842] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.912129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.912252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.912504] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.912720] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.923430] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 in Status: IN_PROGRESS for 2s [ 858.372846] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.373167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.373167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.373397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.393172] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.393445] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.393596] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.393649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.394129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.394129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.394129] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 858.424526] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.424526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.424526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.424526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.425075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.434617] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 858.469656] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.469971] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.471254] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.471254] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.471254] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.471254] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.471254] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.471254] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.471254] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.471541] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 858.471541] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 858.471602] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 858.471873] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 858.471873] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 858.472018] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 858.472355] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 858.483990] env[71140]: INFO networking_nsxv3.common.synchronization [req-98e4010a-5298-440c-982b-a79717e6a87f req-0ed845c2-275c-4e9e-9df5-74b52106d658 tempest-DeleteServersTestJSON-1199867382 tempest-DeleteServersTestJSON-1199867382-project-member] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 858.484548] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 858.484802] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.485281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.485281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.485281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.485473] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.485473] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.485579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.485645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.485728] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.485819] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.503509] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 858.503509] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 858.503509] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 858.503509] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.503509] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-0071092e-f883-4a73-8f61-b9d10c4964d1 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.503509] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-0071092e-f883-4a73-8f61-b9d10c4964d1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.503509] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-0071092e-f883-4a73-8f61-b9d10c4964d1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.503975] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-0071092e-f883-4a73-8f61-b9d10c4964d1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.503975] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0071092e-f883-4a73-8f61-b9d10c4964d1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.992527] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.992698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.992777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.993008] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.008102] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.008392] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.008498] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.008845] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.009111] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.009196] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 0071092e-f883-4a73-8f61-b9d10c4964d1 not found, creating... [ 859.013017] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.013017] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.013017] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.013017] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.013017] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.013017] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.013017] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.013017] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.013017] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.013439] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.013439] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 0071092e-f883-4a73-8f61-b9d10c4964d1 is going to be created. [ 859.023327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.023327] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.023523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.023558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.023895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.023895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.023895] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be updated. [ 859.033607] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.033812] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.033938] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.034250] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.034481] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.034706] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-0071092e-f883-4a73-8f61-b9d10c4964d1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.054782] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.054929] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.055011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.055222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.055359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.063833] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 859.116146] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: SUCCESS [ 859.116384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.674410] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 in Status: SUCCESS [ 859.674410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.674410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.674410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.674410] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.705937] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: SUCCESS [ 859.706167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.814100] env[71140]: INFO networking_nsxv3.common.synchronization [req-73c52080-71ea-402d-8250-7270c292c9c8 req-0b24f100-9dde-46af-ba46-70247d7db776 service nova] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_rules [ 859.814304] env[71140]: INFO networking_nsxv3.common.synchronization [req-73c52080-71ea-402d-8250-7270c292c9c8 req-0b24f100-9dde-46af-ba46-70247d7db776 service nova] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 859.814442] env[71140]: INFO networking_nsxv3.common.synchronization [req-73c52080-71ea-402d-8250-7270c292c9c8 req-0b24f100-9dde-46af-ba46-70247d7db776 service nova] Enqueued Resource ID: 0071092e-f883-4a73-8f61-b9d10c4964d1 with Priority: HIGHEST for action port [ 859.815098] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_rules [ 859.815098] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 859.815098] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0071092e-f883-4a73-8f61-b9d10c4964d1 with Priority: HIGHEST for action port [ 859.815513] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.815637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.815705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.815938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.816010] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.816790] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.816928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.817161] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-0071092e-f883-4a73-8f61-b9d10c4964d1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.817322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0071092e-f883-4a73-8f61-b9d10c4964d1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.817322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0071092e-f883-4a73-8f61-b9d10c4964d1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.817537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0071092e-f883-4a73-8f61-b9d10c4964d1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.817653] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0071092e-f883-4a73-8f61-b9d10c4964d1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.933217] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 in Status: SUCCESS [ 859.933527] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 deletion is rescheduled due to dependency. [ 859.934196] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.176068] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.176223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.176302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.176532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.176695] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.176796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.176910] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.177112] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.177411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.177411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.177411] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.318916] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.319298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.319528] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0071092e-f883-4a73-8f61-b9d10c4964d1 with status ACTIVE [ 860.319716] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.319828] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.319891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.320110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.320193] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.320360] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.320450] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.320509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.320659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.320731] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.320929] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.321025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.321087] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.321226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.321294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.321375] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0071092e-f883-4a73-8f61-b9d10c4964d1 is going to be updated. [ 860.343813] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.344011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.344048] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.344248] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.344388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.344546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0071092e-f883-4a73-8f61-b9d10c4964d1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.446194] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 860.446650] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 deletion is rescheduled due to dependency. [ 860.446857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.447462] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.447897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.448103] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.448222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.448296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.448462] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.448544] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.448638] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.682352] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.682352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.682352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.682352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.682352] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.682352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.682352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.682352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.682352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.682352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.682352] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.682352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.682352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.682352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.683110] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.683110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.683110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.683110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.683110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.683110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.683110] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.951506] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.075022] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 861.075022] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 deletion is rescheduled due to dependency. [ 861.075022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.185523] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30ff0c23-f932-4ef1-8e47-6bf1171fa339: rpc.has_security_group_logging(os_id): False [ 861.207726] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.207945] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.208083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.208239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.208334] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.208552] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.208685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.208781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.208863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.208959] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.209122] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.209213] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.209278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.209432] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.209508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.209698] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.209855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.209855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.210000] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.210640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.210829] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 is going to be updated. [ 861.272578] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.272758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.272835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.273016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.273175] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.284349] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 in Status: IN_PROGRESS for 2s [ 861.453575] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.961409] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.961409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.961409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.961409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.961409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.961409] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 861.989971] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.989971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.989971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.989971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.989971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.997993] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 863.298917] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 in Status: SUCCESS [ 863.299185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.016098] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 864.016341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.016590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.016815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.017055] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.017181] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.017271] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.017487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.017610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.017724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.017822] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.520209] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.520819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.520819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.520819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.521428] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.521428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.521428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.521632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.521632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.521737] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.521912] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.522030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.522129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.522310] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.522491] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.522602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.522684] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.522820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.522904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.522991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.523607] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.816312] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 864.816312] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 865.026496] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2975c43-5d19-4643-8076-5d24f0ea84c6: rpc.has_security_group_logging(os_id): False [ 865.043062] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.043062] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.043062] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.044570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.044570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.044570] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.044570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.044570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.044570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.044570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.044570] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.044570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.044938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.045265] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.045265] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.045402] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.045572] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.045676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.045884] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.046018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.046149] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 865.100422] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.100613] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.100681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.100856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.101016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.115226] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 866.465921] env[71140]: INFO networking_nsxv3.common.synchronization [None req-d0d054f8-f7ce-426e-8122-1912119b3bd0 None None] Enqueued Resource ID: de970a84-fe6b-45e7-b704-4e2a58debc8c with Priority: HIGHEST for action port [ 866.466593] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de970a84-fe6b-45e7-b704-4e2a58debc8c with Priority: HIGHEST for action port [ 866.467041] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-de970a84-fe6b-45e7-b704-4e2a58debc8c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.468452] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de970a84-fe6b-45e7-b704-4e2a58debc8c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.468553] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de970a84-fe6b-45e7-b704-4e2a58debc8c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.468875] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de970a84-fe6b-45e7-b704-4e2a58debc8c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.468986] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de970a84-fe6b-45e7-b704-4e2a58debc8c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.928791] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.928791] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.928791] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.928791] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.928791] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.973213] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de970a84-fe6b-45e7-b704-4e2a58debc8c [ 866.973520] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.973695] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.973796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.974120] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.974247] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.974377] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de970a84-fe6b-45e7-b704-4e2a58debc8c already deleted. [ 866.974494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de970a84-fe6b-45e7-b704-4e2a58debc8c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.129277] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 867.129552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.301192] env[71140]: INFO networking_nsxv3.common.synchronization [req-63ba81f7-987b-442e-88a3-d1eff4d9476a req-0b52bf2f-d1b7-42d0-9d09-cabe12a0be97 tempest-ServersTestBootFromVolume-320963912 tempest-ServersTestBootFromVolume-320963912-project-member] Enqueued Resource ID: 1b5a6141-3574-468b-87ed-785459f7a84a with Priority: HIGHEST for action security_group_members [ 867.301521] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5a6141-3574-468b-87ed-785459f7a84a with Priority: HIGHEST for action security_group_members [ 867.301834] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b5a6141-3574-468b-87ed-785459f7a84a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.301960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.302116] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.302338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.302509] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.302640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.302679] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.302810] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.302895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.302988] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b5a6141-3574-468b-87ed-785459f7a84a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.432316] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.806411] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.806689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.806689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.806827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.826885] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.827777] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.827777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.827777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.827777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.827777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.827777] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b5a6141-3574-468b-87ed-785459f7a84a is going to be updated. [ 867.852498] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.852498] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.852498] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.852498] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.852498] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.859091] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b5a6141-3574-468b-87ed-785459f7a84a in Status: IN_PROGRESS for 2s [ 867.933737] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.949644] env[71140]: INFO networking_nsxv3.common.synchronization [None req-2df50058-6b3d-4c00-ab67-331c957d73ef tempest-ServersTestJSON-593331045 tempest-ServersTestJSON-593331045-project-member] Enqueued Resource ID: a6eb3617-ce46-425c-b053-a5240fa9c14e with Priority: HIGHEST for action security_group_rules [ 867.950426] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6eb3617-ce46-425c-b053-a5240fa9c14e with Priority: HIGHEST for action security_group_rules [ 867.950779] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6eb3617-ce46-425c-b053-a5240fa9c14e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.950972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.950972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.951254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.951343] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6eb3617-ce46-425c-b053-a5240fa9c14e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.053803] env[71140]: INFO networking_nsxv3.common.synchronization [None req-9b376a7e-0faa-4b1e-8ffb-f83a168dc465 tempest-ServersTestJSON-593331045 tempest-ServersTestJSON-593331045-project-member] Enqueued Resource ID: a6eb3617-ce46-425c-b053-a5240fa9c14e with Priority: HIGHEST for action security_group_rules [ 868.054157] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6eb3617-ce46-425c-b053-a5240fa9c14e with Priority: HIGHEST for action security_group_rules [ 868.054455] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6eb3617-ce46-425c-b053-a5240fa9c14e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.054559] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.438445] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 868.438445] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 868.473558] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.473558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.473558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.473558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.473558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.473558] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6eb3617-ce46-425c-b053-a5240fa9c14e already deleted. [ 868.473558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.473558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.473558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.473558] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6eb3617-ce46-425c-b053-a5240fa9c14e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.850684] env[71140]: INFO networking_nsxv3.common.synchronization [None req-7fecacb9-a8e7-43f6-b489-0e903ba56ca4 None None] Enqueued Resource ID: 12a4d8d6-c5c3-4971-be9b-8f8b37d9a78a with Priority: HIGHEST for action port [ 868.852266] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a4d8d6-c5c3-4971-be9b-8f8b37d9a78a with Priority: HIGHEST for action port [ 868.852821] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-12a4d8d6-c5c3-4971-be9b-8f8b37d9a78a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.852918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12a4d8d6-c5c3-4971-be9b-8f8b37d9a78a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.853041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12a4d8d6-c5c3-4971-be9b-8f8b37d9a78a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.853273] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12a4d8d6-c5c3-4971-be9b-8f8b37d9a78a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.853379] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12a4d8d6-c5c3-4971-be9b-8f8b37d9a78a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.008267] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.008426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.008502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.008718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.008821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.008900] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6eb3617-ce46-425c-b053-a5240fa9c14e already deleted. [ 869.009117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.178707] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.178707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.178707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.178707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.188886] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 869.189908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.191121] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 869.222341] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.222800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.222991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.223472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.239449] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.239602] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 869.239602] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 869.239692] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 869.274347] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.274347] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.274347] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.274643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.275896] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.276107] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 869.329801] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.329903] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.329954] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.330207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.330429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.330844] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 869.355220] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12a4d8d6-c5c3-4971-be9b-8f8b37d9a78a [ 869.355452] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.355762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.355762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.355910] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.355956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.356024] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12a4d8d6-c5c3-4971-be9b-8f8b37d9a78a already deleted. [ 869.356109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12a4d8d6-c5c3-4971-be9b-8f8b37d9a78a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.384516] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.384791] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.384791] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.384971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.385519] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.385806] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:38. [ 869.385884] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'0021f162-837d-4356-afbf-4e10e33828d6', '184bb91c-9526-466a-820b-ced20908d98e', '8c99ec8b-0259-4916-a240-54938fc5a81c', 'e2975c43-5d19-4643-8076-5d24f0ea84c6', '30ff0c23-f932-4ef1-8e47-6bf1171fa339', '1100ce56-f855-47e4-96bb-f4bbe37e7632', '94b91392-e2c9-4bb1-8e2f-6bc3569d8721', '4c549bd3-468a-4655-b709-3480ff374e11', '93e058db-48b8-4fa6-b206-7dbbf9ae47ca', 'd3f5bae4-a3a0-45b0-a27b-8d93ffb5c470', 'f065f4e4-d6ea-4bca-9d45-213c57a908b4', 'fcc20535-4cb4-4221-b041-8dd02e4b3787', 'f2accb7b-fbb3-4bd3-a819-611c041bf352', '55e60b37-609d-4b81-9e67-30880d24466d', '55ee773a-5784-4390-9b7c-2b9d4342369e', '8fa22f34-dd54-4c36-9be4-89ad63b6e1be', '43a772d0-e00d-4627-ad2d-c6c3ccbcee06', '0dc568fd-a881-4f9a-8e69-8ab0c5fc0597', '7a4b8219-796d-434e-a45e-ef4800a05c31', '30d81b57-1e7d-4b6c-8223-18f586dd832a', 'e1516d35-770d-4ac2-bf00-b0eed6f837f7', '4143c3a0-53e5-4025-8a89-c9d1e7dbb668', 'a008c941-3472-43c0-815f-ad4259496329', '622a5b07-14ae-44ec-94dd-57b4349034a7', '522bdeb8-3be1-4507-b2cc-adc33ff88371', '1b5a6141-3574-468b-87ed-785459f7a84a', 'f9ec394c-128b-4456-9eb1-76442418ea09', 'bc92ef18-2831-4b38-acbe-82e66080661f', 'c62a92b8-4863-4e9d-809d-e8687b429f2a', 'e12e6f08-d99f-4fd3-9323-d04895bd2256', 'dea05fd0-2f31-49b2-a904-3b840403e3a7', '9a300b78-a05e-47a1-bd01-b7e39a483342', '083af43f-5ab0-4b05-a7bb-d6121e5f0390', '604d5290-2f79-4d99-b6f1-1e0335d615a9', '54bba0b8-b95d-4902-8afe-f2600efb516b', 'b2ad47d5-b746-415d-9e5e-05d9539a1fb9', '6f6ea965-586b-4847-a20f-3619378cb260', '40b2250b-502e-4365-a6ba-2ea8c2fa6c5e'} {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 869.385998] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 869.389746] env[71140]: INFO networking_nsxv3.common.synchronization [req-3a30972d-e32f-4976-8367-c33f8a2f1c1a req-1d5bd09a-61a9-4ae9-9034-4d500ca8d4f5 tempest-ServerMetadataNegativeTestJSON-1453221679 tempest-ServerMetadataNegativeTestJSON-1453221679-project-member] Enqueued Resource ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a with Priority: HIGHEST for action security_group_members [ 869.389817] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a with Priority: HIGHEST for action security_group_members [ 869.390094] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.390226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.390288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.390495] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.390641] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.390748] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.390806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.390950] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.391115] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.391183] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3e5dc50-8f82-494d-8a76-86f2e68a6f6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.406057] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.411019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.411019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.411019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.411019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.411019] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 869.411019] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 869.411019] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 869.532814] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.532814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.532814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.532814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.534301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.534301] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 869.534503] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 869.534503] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 869.534503] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 869.534623] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/38 resources of Type:Security Group Rules [ 869.534623] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGH for action security_group_rules [ 869.534704] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGH for action security_group_rules [ 869.534750] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGH for action security_group_rules [ 869.534852] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGH for action security_group_rules [ 869.534903] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGH for action security_group_rules [ 869.534948] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGH for action security_group_rules [ 869.535573] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGH for action security_group_rules [ 869.535724] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGH for action security_group_rules [ 869.537163] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca with Priority: HIGH for action security_group_rules [ 869.537163] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGH for action security_group_rules [ 869.537163] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 with Priority: HIGH for action security_group_rules [ 869.537163] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 with Priority: HIGH for action security_group_rules [ 869.537163] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 with Priority: HIGH for action security_group_rules [ 869.537163] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55e60b37-609d-4b81-9e67-30880d24466d with Priority: HIGH for action security_group_rules [ 869.537163] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55ee773a-5784-4390-9b7c-2b9d4342369e with Priority: HIGH for action security_group_rules [ 869.537163] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be with Priority: HIGH for action security_group_rules [ 869.537163] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGH for action security_group_rules [ 869.537163] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGH for action security_group_rules [ 869.537163] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 with Priority: HIGH for action security_group_rules [ 869.537163] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGH for action security_group_rules [ 869.537163] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.839718] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-636 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.839919] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-636" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.840055] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-636" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.840381] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-636" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.840639] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.840799] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.840918] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.841164] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.841330] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.841545] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 869.841658] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.841765] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.841872] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.841997] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 869.842102] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.842233] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.860152] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.860529] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 869.860529] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.860658] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-636" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.860971] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-497880e0-61d2-47b9-8a12-efc600120fa7 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.861171] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-497880e0-61d2-47b9-8a12-efc600120fa7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.861287] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-497880e0-61d2-47b9-8a12-efc600120fa7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.861608] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-497880e0-61d2-47b9-8a12-efc600120fa7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.861749] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('497880e0-61d2-47b9-8a12-efc600120fa7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.871238] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b5a6141-3574-468b-87ed-785459f7a84a in Status: SUCCESS [ 869.871395] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b5a6141-3574-468b-87ed-785459f7a84a deletion is rescheduled due to dependency. [ 869.871608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b5a6141-3574-468b-87ed-785459f7a84a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.896444] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.896602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.896678] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.896925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.897039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.897246] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.897350] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.897413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.897570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.897649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.897734] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a already deleted. [ 869.897813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.368019] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.368019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.368019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.368019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.368019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.368019] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 497880e0-61d2-47b9-8a12-efc600120fa7 not found, creating... [ 870.368019] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.368019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.368019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.368019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.368607] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.368607] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.368607] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.368607] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.369121] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.369466] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.371056] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 497880e0-61d2-47b9-8a12-efc600120fa7 is going to be created. [ 870.388859] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.388859] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.388859] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.388859] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.389144] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.389856] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-497880e0-61d2-47b9-8a12-efc600120fa7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.178322] env[71140]: INFO networking_nsxv3.common.synchronization [req-3a30972d-e32f-4976-8367-c33f8a2f1c1a req-95efad2a-9950-40bf-a140-623792b2f2d7 service nova] Enqueued Resource ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a with Priority: HIGHEST for action security_group_rules [ 871.178322] env[71140]: INFO networking_nsxv3.common.synchronization [req-3a30972d-e32f-4976-8367-c33f8a2f1c1a req-95efad2a-9950-40bf-a140-623792b2f2d7 service nova] Enqueued Resource ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a with Priority: HIGHEST for action security_group_members [ 871.178322] env[71140]: INFO networking_nsxv3.common.synchronization [req-3a30972d-e32f-4976-8367-c33f8a2f1c1a req-95efad2a-9950-40bf-a140-623792b2f2d7 service nova] Enqueued Resource ID: 497880e0-61d2-47b9-8a12-efc600120fa7 with Priority: HIGHEST for action port [ 871.178759] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a with Priority: HIGHEST for action security_group_rules [ 871.178896] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a with Priority: HIGHEST for action security_group_members [ 871.179204] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 497880e0-61d2-47b9-8a12-efc600120fa7 with Priority: HIGHEST for action port [ 871.179438] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGH for action security_group_rules [ 871.179518] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGH for action security_group_rules [ 871.179575] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGH for action security_group_rules [ 871.179675] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55ee773a-5784-4390-9b7c-2b9d4342369e with Priority: HIGH for action security_group_rules [ 871.179810] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGH for action security_group_rules [ 871.179938] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 with Priority: HIGH for action security_group_rules [ 871.179938] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 with Priority: HIGH for action security_group_rules [ 871.180045] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGH for action security_group_rules [ 871.180127] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55e60b37-609d-4b81-9e67-30880d24466d with Priority: HIGH for action security_group_rules [ 871.180214] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be with Priority: HIGH for action security_group_rules [ 871.180302] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 with Priority: HIGH for action security_group_rules [ 871.180388] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 with Priority: HIGH for action security_group_rules [ 871.180475] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 with Priority: HIGH for action security_group_rules [ 871.180560] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGH for action security_group_rules [ 871.180693] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca with Priority: HIGH for action security_group_rules [ 871.180740] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGH for action security_group_rules [ 871.180800] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGH for action security_group_rules [ 871.180891] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGH for action security_group_rules [ 871.180972] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGH for action security_group_rules [ 871.181064] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGH for action security_group_rules [ 871.181365] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.181477] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.181536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.181844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.181930] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3e5dc50-8f82-494d-8a76-86f2e68a6f6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.183322] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.183444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.183568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.183683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.184099] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.184099] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.184099] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.184257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.184257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.184357] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3e5dc50-8f82-494d-8a76-86f2e68a6f6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.185406] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-497880e0-61d2-47b9-8a12-efc600120fa7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.185633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-497880e0-61d2-47b9-8a12-efc600120fa7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.188249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-497880e0-61d2-47b9-8a12-efc600120fa7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.188554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-497880e0-61d2-47b9-8a12-efc600120fa7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.188554] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('497880e0-61d2-47b9-8a12-efc600120fa7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.189982] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.190123] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.190175] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.190590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.190590] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.191701] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.191822] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.191878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.192028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.192575] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.194704] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.194819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.194892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.195177] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.195177] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.196338] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55ee773a-5784-4390-9b7c-2b9d4342369e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.196338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.196338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.196338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.196338] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55ee773a-5784-4390-9b7c-2b9d4342369e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.197244] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30d81b57-1e7d-4b6c-8223-18f586dd832a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.197244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.197244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.197244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.197454] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.199185] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a4b8219-796d-434e-a45e-ef4800a05c31 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.199304] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.199381] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.199722] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.199802] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a4b8219-796d-434e-a45e-ef4800a05c31',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.200576] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.200672] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.200744] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.200889] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.200951] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dc568fd-a881-4f9a-8e69-8ab0c5fc0597',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.205311] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.205433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.205511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.205693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.205772] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.206025] env[71140]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 871.206929] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55e60b37-609d-4b81-9e67-30880d24466d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.207166] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.207224] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.207458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.207531] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55e60b37-609d-4b81-9e67-30880d24466d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.209826] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fa22f34-dd54-4c36-9be4-89ad63b6e1be taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.210107] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.210171] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.210730] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.210730] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fa22f34-dd54-4c36-9be4-89ad63b6e1be',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.211622] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2accb7b-fbb3-4bd3-a819-611c041bf352 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.211779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.211813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.211950] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.212353] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2accb7b-fbb3-4bd3-a819-611c041bf352',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.212862] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcc20535-4cb4-4221-b041-8dd02e4b3787 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.212972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.213512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.213512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.213512] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcc20535-4cb4-4221-b041-8dd02e4b3787',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.214693] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f065f4e4-d6ea-4bca-9d45-213c57a908b4 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.214816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.214867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.215057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.215312] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f065f4e4-d6ea-4bca-9d45-213c57a908b4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.216893] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.216893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.216893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.217141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.217184] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.218440] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93e058db-48b8-4fa6-b206-7dbbf9ae47ca taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.218549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.218629] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.218810] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.219020] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93e058db-48b8-4fa6-b206-7dbbf9ae47ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.220667] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.220938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.220938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.221084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.221145] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.222247] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.222368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.222428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.222563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.222654] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.223965] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.224198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.224198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.224783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.224783] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.224911] env[71140]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 871.225844] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.226087] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.226264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.226315] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.226381] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.227650] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.227770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.227770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.227895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.228023] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.235786] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.235953] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.236052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.236231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.236386] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.236485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.236546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.236689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.236777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.236865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.236981] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.399627] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.399758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.399830] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.400040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.426926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.427097] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a4b8219-796d-434e-a45e-ef4800a05c31 is going to be deleted. [ 871.490884] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.491052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.491138] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.491988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.491988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.491988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a4b8219-796d-434e-a45e-ef4800a05c31" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.685866] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.686093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.687185] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3e5dc50-8f82-494d-8a76-86f2e68a6f6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.690355] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 497880e0-61d2-47b9-8a12-efc600120fa7 with status ACTIVE [ 871.690679] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.690882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.690994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.692250] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.692250] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.692250] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.692250] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.692250] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.692464] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.692464] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.692707] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.692857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.692955] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.693196] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.694244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.694244] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 497880e0-61d2-47b9-8a12-efc600120fa7 is going to be updated. [ 871.695706] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.695706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.695706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.695926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.695983] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.697129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.697129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.697129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.697129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.697129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.697129] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.699264] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.699264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.699264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.699264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.699264] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.699264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.699632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.699632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.699704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.699813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.700303] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.701552] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30d81b57-1e7d-4b6c-8223-18f586dd832a taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.701768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.701861] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.702094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.702378] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.702531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.702632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.702860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.702983] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.703144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.703289] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.724052] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.724052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.724052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.724052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.724052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.724436] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-497880e0-61d2-47b9-8a12-efc600120fa7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.738558] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.748289] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.748439] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.748509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.748796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.767814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.768094] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55ee773a-5784-4390-9b7c-2b9d4342369e is going to be deleted. [ 871.854521] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.854676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.854676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.854931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.855070] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.855120] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55ee773a-5784-4390-9b7c-2b9d4342369e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.865901] env[71140]: INFO networking_nsxv3.common.synchronization [req-38e69232-87ca-43a8-aeb4-7626dfe967f6 req-e31329b6-3721-4289-8826-fbef9f15d114 tempest-ImagesTestJSON-1376189349 tempest-ImagesTestJSON-1376189349-project-member] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 871.866638] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 871.867060] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.867199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.867277] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.867476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.867656] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.867794] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.867794] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.867933] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.868060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.868147] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.908101] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcc20535-4cb4-4221-b041-8dd02e4b3787 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.908387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.908387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.908582] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.909033] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.909033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.909033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.909217] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.909217] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.909217] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.909328] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fcc20535-4cb4-4221-b041-8dd02e4b3787',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.914026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.914026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.914026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.914026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.914026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.914026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.914026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.914026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.914026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.914026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.914026] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.920040] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.920172] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.920236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.920461] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.920619] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.921367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.921367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.921367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.921367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.921367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.921367] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.925140] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.925270] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.925373] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.925564] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.925804] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.925890] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.925976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.926172] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.926508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.926508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.926508] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.927383] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.927485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.928030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.928030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.928030] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.928030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.928238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.928275] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.931031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.931031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.931031] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.932128] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.932297] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.932403] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.933238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.933238] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.933238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.933238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.933238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.933545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.933545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.933545] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.937703] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.937778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.937865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.938091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.968866] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.968866] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.983311] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.983439] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.984431] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.984544] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.985299] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.985394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.987405] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.987405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.989405] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.989491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.998513] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.998513] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.000769] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.000877] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be deleted. [ 872.001896] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.002056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.023755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.024072] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2accb7b-fbb3-4bd3-a819-611c041bf352 is going to be deleted. [ 872.025208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.025513] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.048503] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.048646] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f065f4e4-d6ea-4bca-9d45-213c57a908b4 is going to be deleted. [ 872.049651] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.049861] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.058242] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.058406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.072725] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.073163] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fa22f34-dd54-4c36-9be4-89ad63b6e1be is going to be deleted. [ 872.074316] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.074598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.100352] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.100566] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.113285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.113505] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55e60b37-609d-4b81-9e67-30880d24466d is going to be deleted. [ 872.114475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.114728] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.121051] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.121051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.167671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.167914] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dc568fd-a881-4f9a-8e69-8ab0c5fc0597 is going to be deleted. [ 872.169277] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.169795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.176017] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.176017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.190776] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3e5dc50-8f82-494d-8a76-86f2e68a6f6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.204341] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.204341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.204341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.204341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.204341] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.204341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.204341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.204341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.204341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.204341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.204341] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.204341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.204341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.204341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.205071] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.205071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.205071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.205071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.205071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.205071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.205071] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.209604] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.210663] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.212784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.212888] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93e058db-48b8-4fa6-b206-7dbbf9ae47ca is going to be deleted. [ 872.213873] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.214103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.241629] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94b91392-e2c9-4bb1-8e2f-6bc3569d8721: rpc.has_security_group_logging(os_id): False [ 872.244229] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.244316] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.265550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.265550] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be deleted. [ 872.265760] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.265825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.265930] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.266046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.266248] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.266352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.266425] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.266551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2accb7b-fbb3-4bd3-a819-611c041bf352" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.267063] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.267205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.267284] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.267418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f065f4e4-d6ea-4bca-9d45-213c57a908b4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.267890] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.268122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.268258] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.268415] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fa22f34-dd54-4c36-9be4-89ad63b6e1be" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.268548] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.268695] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.269351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.269351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55e60b37-609d-4b81-9e67-30880d24466d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.305721] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.305898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.305965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.306188] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.306280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.307028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dc568fd-a881-4f9a-8e69-8ab0c5fc0597" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.308791] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.308791] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.308791] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.308791] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.353165] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.353567] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.354056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.354238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.354536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.354660] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.354796] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 is going to be updated. [ 872.357470] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.357644] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.357710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.357868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.358023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.358144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93e058db-48b8-4fa6-b206-7dbbf9ae47ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.371147] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.371328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.371395] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.371539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.371625] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.371815] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.371907] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.371981] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.372130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.372285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.372285] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be updated. [ 872.411394] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.411540] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.411604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.411818] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.411912] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.412046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.412279] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fcc20535-4cb4-4221-b041-8dd02e4b3787',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.417087] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.417231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.417328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.417487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.417634] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.417728] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.417784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.417960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.418111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.418183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.418311] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.418428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.418500] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.418591] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.418720] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.418812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.418865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.419011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.419083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.419161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.419262] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.433072] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.433072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.433072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.433072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.433072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.440306] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.440453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.440679] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.440679] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.440811] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.440951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.440951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.441490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.441490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.441490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.441490] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.441490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.441756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.441756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.441756] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.442588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.442588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.442588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.442588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.442588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.442588] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.443137] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.443239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.443302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.443976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.443976] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.443976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.443976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.443976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.443976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.443976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.444514] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.444514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.444514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.444514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.444514] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.444763] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.444763] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.447394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.447394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.447394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.447394] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.447394] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.447394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.447394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.447394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.447394] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.447394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.447394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.447394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.447394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.447394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.447394] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.447394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.447394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.448122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.448122] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.448122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.448122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.448122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.448122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.448122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.448122] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.449418] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.449418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.449538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.449577] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.453019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.453019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.453019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.453019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.453019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.453019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.453019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.453019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.453019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.453019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.453019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.453019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.453019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.453019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.453019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.453019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.453019] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.454284] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 872.520922] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.521176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.521176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.521409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.521569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.539939] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-920 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.540863] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.540863] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.541162] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.541575] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.541809] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.542092] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.542437] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.542986] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.547038] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 872.547038] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 872.547038] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 872.547038] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 872.547038] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 872.547038] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 872.547038] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 872.547705] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 in Status: IN_PROGRESS for 2s [ 872.595979] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 872.596209] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.051 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 872.596314] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 872.596500] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.596832] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-26799ee5-cde3-4889-9999-e4209ec62369 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.597090] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-26799ee5-cde3-4889-9999-e4209ec62369" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.597223] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-26799ee5-cde3-4889-9999-e4209ec62369" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.597566] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-26799ee5-cde3-4889-9999-e4209ec62369" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.597723] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26799ee5-cde3-4889-9999-e4209ec62369',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.696675] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.696675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.696675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.697435] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.697435] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.697435] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a is going to be created. [ 872.709863] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0021f162-837d-4356-afbf-4e10e33828d6: rpc.has_security_group_logging(os_id): False [ 872.712475] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30d81b57-1e7d-4b6c-8223-18f586dd832a: rpc.has_security_group_logging(os_id): False [ 872.713364] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c99ec8b-0259-4916-a240-54938fc5a81c: rpc.has_security_group_logging(os_id): False [ 872.732317] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.732513] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.732578] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.732738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.734484] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.734655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.736407] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.736547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.739124] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.739124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.739124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.739124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.739124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.746393] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a in Status: UNINITIALIZED for 2s [ 872.754107] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.754430] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.754529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.754597] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.754855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.755044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.755150] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c is going to be updated. [ 872.756231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.756539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.773871] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.774199] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.774346] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.774393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.775126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.775126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.775126] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.775126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.775126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.775356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.775356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.775460] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.775536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.775574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.775686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.775757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.775837] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0021f162-837d-4356-afbf-4e10e33828d6 is going to be updated. [ 872.776879] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.778252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.820200] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.820524] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.820649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.820719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.820928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.821034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.821148] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a is going to be updated. [ 872.853754] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.853930] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.853973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.854186] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.854331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.858365] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.858365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.858365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.858365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.858365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.865501] env[71140]: INFO networking_nsxv3.common.synchronization [req-7f7e1ea5-a06b-4e5d-b317-b2c1ad69d8f0 req-a71029bf-19c2-46ba-80ac-3cee87a2d20b tempest-ImagesOneServerNegativeTestJSON-512607698 tempest-ImagesOneServerNegativeTestJSON-512607698-project-member] Enqueued Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 872.866091] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 872.866430] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.867135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.867135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.867135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.867135] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.867135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.867417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.867417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.867487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.867532] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.869095] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0021f162-837d-4356-afbf-4e10e33828d6 in Status: IN_PROGRESS for 2s [ 872.869772] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: IN_PROGRESS for 2s [ 872.883372] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.883588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.883659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.883862] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.887023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.906018] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a in Status: IN_PROGRESS for 2s [ 872.916178] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fcc20535-4cb4-4221-b041-8dd02e4b3787: rpc.has_security_group_logging(os_id): False [ 872.920834] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 184bb91c-9526-466a-820b-ced20908d98e: rpc.has_security_group_logging(os_id): False [ 872.940660] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.940803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.940875] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.941117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.944024] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.944134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.955103] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1100ce56-f855-47e4-96bb-f4bbe37e7632: rpc.has_security_group_logging(os_id): False [ 872.955103] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2975c43-5d19-4643-8076-5d24f0ea84c6: rpc.has_security_group_logging(os_id): False [ 872.955534] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30ff0c23-f932-4ef1-8e47-6bf1171fa339: rpc.has_security_group_logging(os_id): False [ 872.956302] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470: rpc.has_security_group_logging(os_id): False [ 872.959290] env[71140]: INFO networking_nsxv3.common.synchronization [req-02537a9e-fad3-4c05-9b69-348bb125183d req-f7696cb8-d4c0-4cfa-b81d-d7832215bf8e tempest-VolumesAdminNegativeTest-302320000 tempest-VolumesAdminNegativeTest-302320000-project-member] Enqueued Resource ID: bc92ef18-2831-4b38-acbe-82e66080661f with Priority: HIGHEST for action security_group_members [ 872.960902] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc92ef18-2831-4b38-acbe-82e66080661f with Priority: HIGHEST for action security_group_members [ 872.961895] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc92ef18-2831-4b38-acbe-82e66080661f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.962031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.962103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.962326] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.962524] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.962648] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.962729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.962920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.963018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.963129] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc92ef18-2831-4b38-acbe-82e66080661f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.969731] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.970013] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.970118] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.970172] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.970339] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.970418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.970504] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 is going to be updated. [ 872.971673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.974020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.991306] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.991306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.993154] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.993292] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.994655] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.994778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.002814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.003056] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.003224] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.003306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.003615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.003615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.003862] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.003986] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.004095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.004282] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.004381] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.004612] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.004706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.004771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.004921] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.005008] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.009407] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be updated. [ 873.011443] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.011443] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.012138] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.012234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.048137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.051019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.051019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.051019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.051019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.051019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.051019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.051019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.051019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.051019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.051019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.051019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.051019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.051019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.051645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.051645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.051645] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 is going to be updated. [ 873.052840] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.053503] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.079146] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.079146] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.081069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.081355] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.082299] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.082299] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.082299] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.082299] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.082738] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.083846] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.083846] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.083846] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.083846] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.083846] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.084075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.084236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.084471] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.084639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.087687] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 873.087687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.087687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.103194] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.103194] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.103194] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.103194] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.103194] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.103194] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 26799ee5-cde3-4889-9999-e4209ec62369 not found, creating... [ 873.103194] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.103194] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.103194] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.103194] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.103674] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.103674] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.103674] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.103674] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.104326] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.104570] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.104837] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 26799ee5-cde3-4889-9999-e4209ec62369 is going to be created. [ 873.107427] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.107750] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.108576] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.108766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.109042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.109215] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.109493] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.109701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.109843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.110097] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.110289] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.110571] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.110762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.110905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.111226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.112591] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.112591] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 873.112591] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.112853] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.113093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.114163] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.114561] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.116348] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.116926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.139953] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.139953] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.139953] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.139953] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.139953] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.141755] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-26799ee5-cde3-4889-9999-e4209ec62369" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.141755] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 in Status: IN_PROGRESS for 2s [ 873.143415] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.143540] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.145256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.145881] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.145881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.145881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.145881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.145881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.147232] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.147232] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.147232] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.147232] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.147232] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.147232] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.147232] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.147232] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.147232] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.147232] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.147232] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 is going to be updated. [ 873.148080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.148247] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.148385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.149523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.149686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.149807] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.174312] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.174522] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.174522] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.174731] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.174915] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.224040] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: IN_PROGRESS for 2s [ 873.237862] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: IN_PROGRESS for 2s [ 873.286817] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 873.296878] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.297194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.297194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.297387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.297533] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.314468] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.314707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.314707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.314932] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.315109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.355661] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 873.359185] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 in Status: IN_PROGRESS for 2s [ 873.371745] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.372044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.372044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.372229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.372291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.372503] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.372620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.372690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.372803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.372871] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.372948] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 is going to be updated. [ 873.457888] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.458159] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.458246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.458468] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.458645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.465621] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.465802] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.465849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.466131] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.472527] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: IN_PROGRESS for 2s [ 873.498057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.498232] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.498308] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.498391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.498615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.498702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.498761] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc92ef18-2831-4b38-acbe-82e66080661f is going to be updated. [ 873.527202] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.527646] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.527646] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.527753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.528041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.538628] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc92ef18-2831-4b38-acbe-82e66080661f in Status: IN_PROGRESS for 2s [ 873.965534] env[71140]: INFO networking_nsxv3.common.synchronization [req-38e69232-87ca-43a8-aeb4-7626dfe967f6 req-05ee3b01-d807-415c-92e2-dd2979ee3fa5 service nova] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_rules [ 873.965843] env[71140]: INFO networking_nsxv3.common.synchronization [req-38e69232-87ca-43a8-aeb4-7626dfe967f6 req-05ee3b01-d807-415c-92e2-dd2979ee3fa5 service nova] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 873.966474] env[71140]: INFO networking_nsxv3.common.synchronization [req-38e69232-87ca-43a8-aeb4-7626dfe967f6 req-05ee3b01-d807-415c-92e2-dd2979ee3fa5 service nova] Enqueued Resource ID: 26799ee5-cde3-4889-9999-e4209ec62369 with Priority: HIGHEST for action port [ 873.966898] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_rules [ 873.967174] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 873.967258] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26799ee5-cde3-4889-9999-e4209ec62369 with Priority: HIGHEST for action port [ 873.967613] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.967767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.967850] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.968210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.968360] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.969763] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.969763] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.969763] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-26799ee5-cde3-4889-9999-e4209ec62369 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.970775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26799ee5-cde3-4889-9999-e4209ec62369" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.970775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26799ee5-cde3-4889-9999-e4209ec62369" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.970775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26799ee5-cde3-4889-9999-e4209ec62369" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.970775] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26799ee5-cde3-4889-9999-e4209ec62369',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.465442] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 874.465838] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 deletion is rescheduled due to dependency. [ 874.465838] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.465923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.466161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.466311] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.466430] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.466513] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.466673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.466756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.466852] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.476776] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.476776] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.476776] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26799ee5-cde3-4889-9999-e4209ec62369 with status ACTIVE [ 874.476776] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.476776] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.476776] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.477252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.477356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.477552] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.478441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.478441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.478441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.478441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.478441] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.478441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.478441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.478793] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.478793] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.478793] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26799ee5-cde3-4889-9999-e4209ec62369 is going to be updated. [ 874.497935] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.498173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.498234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.498416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.498572] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.498744] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26799ee5-cde3-4889-9999-e4209ec62369" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.559127] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 in Status: SUCCESS [ 874.559315] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.757041] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a in Status: SUCCESS [ 874.757402] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.757696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.757916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.758240] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.758380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.758513] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.758760] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.758861] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.758963] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.759108] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3e5dc50-8f82-494d-8a76-86f2e68a6f6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.885131] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0021f162-837d-4356-afbf-4e10e33828d6 in Status: SUCCESS [ 874.885360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.886127] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: SUCCESS [ 874.886316] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.918434] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a in Status: SUCCESS [ 874.918659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.969238] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.153310] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 in Status: SUCCESS [ 875.153544] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.235077] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: SUCCESS [ 875.235327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.248403] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: SUCCESS [ 875.249879] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.261529] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.261529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.261529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.261849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.261908] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.262020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.262083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.262424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.262424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.262552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.262609] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.262687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.262745] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.262880] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.263026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.263120] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.263181] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.263331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.263406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.263465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.263522] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3e5dc50-8f82-494d-8a76-86f2e68a6f6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.302344] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 875.302605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.370041] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 875.370041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.370561] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 in Status: SUCCESS [ 875.370739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.472229] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.481569] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: SUCCESS [ 875.481749] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 deletion is rescheduled due to dependency. [ 875.481867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.548613] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc92ef18-2831-4b38-acbe-82e66080661f in Status: SUCCESS [ 875.549393] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc92ef18-2831-4b38-acbe-82e66080661f deletion is rescheduled due to dependency. [ 875.549521] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc92ef18-2831-4b38-acbe-82e66080661f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.765845] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3e5dc50-8f82-494d-8a76-86f2e68a6f6a: rpc.has_security_group_logging(os_id): False [ 875.783607] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.783830] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.783830] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.784181] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.784280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.784506] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.784610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.784675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.784816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.784908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.785135] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.785135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.785397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.785397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.785475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.785617] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.785706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.785764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.785903] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.786051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.786176] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a is going to be created. [ 875.838097] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.838254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.838345] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.838546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.838730] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.848770] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a in Status: IN_PROGRESS for 2s [ 875.974571] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.974773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.974847] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.975133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.975228] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.975336] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be updated. [ 876.008413] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.008634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.008634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.008895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.009092] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.020105] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 877.861201] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a in Status: SUCCESS [ 877.861483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.029196] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 878.029409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.029565] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.029775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.029963] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.030130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.030204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.030367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.030449] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.030534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.030625] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.534074] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.534324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.534453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.534944] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.535865] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.536158] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.536300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.536600] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.536770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.536960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.537234] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.537481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.537725] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.537941] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.538204] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.538367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.538458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.538619] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.538726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.538818] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.538953] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.757433] env[71140]: INFO networking_nsxv3.common.synchronization [req-769e37e4-cd2c-48e5-83f2-06c5f7e1aa3f req-02644a8d-d13d-4842-979d-1dd294aae2db tempest-ServersTestMultiNic-1825947710 tempest-ServersTestMultiNic-1825947710-project-member] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 878.757981] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 878.758327] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.758447] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.758512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.758714] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.759330] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.759416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.759458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.760037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.760037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.760037] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.042295] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43a772d0-e00d-4627-ad2d-c6c3ccbcee06: rpc.has_security_group_logging(os_id): False [ 879.058810] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.058960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.059047] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.059263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.059357] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.059553] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.059651] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.059747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.059863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.059940] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.060140] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.060236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.060298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.061084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.061084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.061084] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.061084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.061084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.061084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.061084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.061385] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be created. [ 879.116147] env[71140]: INFO networking_nsxv3.common.synchronization [req-769e37e4-cd2c-48e5-83f2-06c5f7e1aa3f req-90e02e80-a266-4e98-a9b9-1fb977895beb tempest-ServersTestMultiNic-1825947710 tempest-ServersTestMultiNic-1825947710-project-member] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 879.116147] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.116147] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.116147] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.116858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.117238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.118914] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 879.119463] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.120409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.130506] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 879.262406] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.262579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.262649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.263013] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.284912] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.285209] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.285354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.285466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.285958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.286483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.286483] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be updated. [ 879.328398] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.328398] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.328398] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.328398] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.328398] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.337047] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: IN_PROGRESS for 2s [ 879.464460] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-323 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.464661] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-323" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.464789] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-323" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.465181] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-323" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.465450] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.465609] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.465730] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.465999] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.466211] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.466467] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 879.466621] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 879.466747] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 879.467104] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 879.467104] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 879.467284] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 879.467339] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 879.484594] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 879.484783] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 879.488022] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 879.488022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-323" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.488022] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-43403cde-4a34-424f-a0d7-caa62e9d8471 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.488022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-43403cde-4a34-424f-a0d7-caa62e9d8471" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.488022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-43403cde-4a34-424f-a0d7-caa62e9d8471" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.488022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-43403cde-4a34-424f-a0d7-caa62e9d8471" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.488022] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43403cde-4a34-424f-a0d7-caa62e9d8471',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.988519] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.988757] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.988889] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.989209] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.989374] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.989531] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 43403cde-4a34-424f-a0d7-caa62e9d8471 not found, creating... [ 879.989815] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.989976] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.990121] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.990359] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.990500] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.990785] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.990945] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.991078] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.991292] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.991429] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.991571] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 43403cde-4a34-424f-a0d7-caa62e9d8471 is going to be created. [ 880.012736] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.012961] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.013109] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.013402] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.013633] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.013908] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-43403cde-4a34-424f-a0d7-caa62e9d8471" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.780200] env[71140]: INFO networking_nsxv3.common.synchronization [req-769e37e4-cd2c-48e5-83f2-06c5f7e1aa3f req-427a61da-0abe-4b0b-958a-4f714b4079e1 service nova] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_rules [ 880.780200] env[71140]: INFO networking_nsxv3.common.synchronization [req-769e37e4-cd2c-48e5-83f2-06c5f7e1aa3f req-427a61da-0abe-4b0b-958a-4f714b4079e1 service nova] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 880.780200] env[71140]: INFO networking_nsxv3.common.synchronization [req-769e37e4-cd2c-48e5-83f2-06c5f7e1aa3f req-427a61da-0abe-4b0b-958a-4f714b4079e1 service nova] Enqueued Resource ID: 43403cde-4a34-424f-a0d7-caa62e9d8471 with Priority: HIGHEST for action port [ 880.780200] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_rules [ 880.780605] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 880.780820] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43403cde-4a34-424f-a0d7-caa62e9d8471 with Priority: HIGHEST for action port [ 880.781487] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.781655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.781743] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.781995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.782116] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.783085] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.783220] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.783464] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-43403cde-4a34-424f-a0d7-caa62e9d8471 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.783604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43403cde-4a34-424f-a0d7-caa62e9d8471" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.783683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43403cde-4a34-424f-a0d7-caa62e9d8471" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.783876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43403cde-4a34-424f-a0d7-caa62e9d8471" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.783969] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43403cde-4a34-424f-a0d7-caa62e9d8471',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.142915] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 881.143196] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.151353] env[71140]: INFO networking_nsxv3.common.synchronization [req-1def4902-48e1-402a-90cc-345fa8b53679 req-73c46f1d-40cf-4b52-a9a2-6c24696e9fab tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 881.151537] env[71140]: INFO networking_nsxv3.common.synchronization [req-1def4902-48e1-402a-90cc-345fa8b53679 req-73c46f1d-40cf-4b52-a9a2-6c24696e9fab tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 with Priority: HIGHEST for action security_group_members [ 881.152881] env[71140]: INFO networking_nsxv3.common.synchronization [req-1def4902-48e1-402a-90cc-345fa8b53679 req-73c46f1d-40cf-4b52-a9a2-6c24696e9fab tempest-SecurityGroupsTestJSON-460719950 tempest-SecurityGroupsTestJSON-460719950-project-member] Enqueued Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGHEST for action security_group_members [ 881.152881] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGHEST for action security_group_members [ 881.152881] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 with Priority: HIGHEST for action security_group_members [ 881.152881] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGHEST for action security_group_members [ 881.152881] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.152881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.152881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.153388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.153388] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.153388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.153388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.153616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.153616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.153713] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.155026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.155148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.155309] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.155368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.155474] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.155569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.155647] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.155849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.155849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.156063] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4143c3a0-53e5-4025-8a89-c9d1e7dbb668',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.157643] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30d81b57-1e7d-4b6c-8223-18f586dd832a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.157806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.157876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.158092] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.158353] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.158463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.158526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.158665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.158741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.158824] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.286584] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.286584] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.287305] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43403cde-4a34-424f-a0d7-caa62e9d8471 with status ACTIVE [ 881.287305] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.287305] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.287305] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.287527] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.287561] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.288878] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.288878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.288878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.288878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.288878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.288878] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.288878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.288878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.288878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.288878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.289392] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43403cde-4a34-424f-a0d7-caa62e9d8471 is going to be updated. [ 881.310024] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.310024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.310024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.310232] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.310294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.310447] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43403cde-4a34-424f-a0d7-caa62e9d8471" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.346198] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 881.346592] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e deletion is rescheduled due to dependency. [ 881.347623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.347893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.348419] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.349025] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.349272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.349489] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.349758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.349856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.349964] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.659056] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.659056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.659056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.659312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.660562] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.660693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.660896] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.661019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.681931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.682196] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.682321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.682628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.682628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.682739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.682739] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 is going to be updated. [ 881.684367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.684809] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.684809] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.685401] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.685401] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.685401] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.685573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.685573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.685701] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a is going to be updated. [ 881.687455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.687622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.687708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.687898] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.688034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.688088] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.688367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.688451] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.688545] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be updated. [ 881.690689] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-990 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.690874] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-990" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.690998] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-990" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.691299] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-990" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.691555] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.691951] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.691951] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.692533] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.692533] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.692731] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 881.692856] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.692968] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.693164] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.694579] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 881.694579] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.694579] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.716326] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.716526] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 881.716672] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.716864] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-990" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.717268] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-9ed62843-eb08-4757-87bc-e7c58516cfd0 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.717454] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-9ed62843-eb08-4757-87bc-e7c58516cfd0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.717577] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-9ed62843-eb08-4757-87bc-e7c58516cfd0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.719659] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-9ed62843-eb08-4757-87bc-e7c58516cfd0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.719659] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ed62843-eb08-4757-87bc-e7c58516cfd0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.722150] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.722229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.722268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.722474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.722606] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.724368] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.724470] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.724563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.724725] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.724848] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.726303] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.726396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.726500] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.726584] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.726690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.736179] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a in Status: IN_PROGRESS for 2s [ 881.736739] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: IN_PROGRESS for 2s [ 881.737311] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 in Status: IN_PROGRESS for 2s [ 881.852356] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.222511] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.222666] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.223337] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.223337] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.223337] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.223506] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 9ed62843-eb08-4757-87bc-e7c58516cfd0 not found, creating... [ 882.223705] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.223864] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.223997] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.224250] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.224971] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.224971] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.224971] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.225290] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.225290] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.225469] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.225571] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 9ed62843-eb08-4757-87bc-e7c58516cfd0 is going to be created. [ 882.248669] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.248882] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.249017] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.249329] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.249562] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.249794] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-9ed62843-eb08-4757-87bc-e7c58516cfd0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.354769] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.859702] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.860037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.860037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.860434] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.860587] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.860971] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be updated. [ 882.891088] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.891240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.891314] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.891523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.891663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.903146] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: IN_PROGRESS for 2s [ 882.996039] env[71140]: INFO networking_nsxv3.common.synchronization [req-769e37e4-cd2c-48e5-83f2-06c5f7e1aa3f req-738f54c5-2f5c-4f1a-b5d4-5410c62568dd service nova] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_rules [ 882.996039] env[71140]: INFO networking_nsxv3.common.synchronization [req-769e37e4-cd2c-48e5-83f2-06c5f7e1aa3f req-738f54c5-2f5c-4f1a-b5d4-5410c62568dd service nova] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 882.996039] env[71140]: INFO networking_nsxv3.common.synchronization [req-769e37e4-cd2c-48e5-83f2-06c5f7e1aa3f req-738f54c5-2f5c-4f1a-b5d4-5410c62568dd service nova] Enqueued Resource ID: 9ed62843-eb08-4757-87bc-e7c58516cfd0 with Priority: HIGHEST for action port [ 882.996039] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_rules [ 882.996039] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 882.996039] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed62843-eb08-4757-87bc-e7c58516cfd0 with Priority: HIGHEST for action port [ 882.996039] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.996039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.996039] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.996039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.996039] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ed62843-eb08-4757-87bc-e7c58516cfd0 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.996039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ed62843-eb08-4757-87bc-e7c58516cfd0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.996039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ed62843-eb08-4757-87bc-e7c58516cfd0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.996039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ed62843-eb08-4757-87bc-e7c58516cfd0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.996039] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ed62843-eb08-4757-87bc-e7c58516cfd0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.498206] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ed62843-eb08-4757-87bc-e7c58516cfd0 with status ACTIVE [ 883.498452] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.498588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.498658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.498864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.498952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.499179] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.499298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.499341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.499487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.499557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.499736] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.499827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.499879] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.500025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.500104] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.500188] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ed62843-eb08-4757-87bc-e7c58516cfd0 is going to be updated. [ 883.520934] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.521187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.521268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.521849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.521849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.521849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ed62843-eb08-4757-87bc-e7c58516cfd0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.749031] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 in Status: SUCCESS [ 883.749203] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 deletion is rescheduled due to dependency. [ 883.749377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.750222] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a in Status: SUCCESS [ 883.750522] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a deletion is rescheduled due to dependency. [ 883.750656] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.751974] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 in Status: SUCCESS [ 883.751974] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 deletion is rescheduled due to dependency. [ 883.751974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.041076] env[71140]: INFO networking_nsxv3.common.synchronization [req-404a542d-c5d1-4eca-8394-87152a2ceeae req-9be9505a-05d4-4ae9-ba41-e087f1e1be65 tempest-ServersWithSpecificFlavorTestJSON-1339181312 tempest-ServersWithSpecificFlavorTestJSON-1339181312-project-member] Enqueued Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_members [ 884.041632] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_members [ 884.042411] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62a92b8-4863-4e9d-809d-e8687b429f2a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.042411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.042411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.042411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.042643] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.042697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.042733] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.042891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.042999] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.043115] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.546513] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.546954] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.547397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.547397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.569389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.569389] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.569389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.569645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.569645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.569714] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.569767] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c62a92b8-4863-4e9d-809d-e8687b429f2a is going to be updated. [ 884.593525] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.593770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.593892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.594317] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.594517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.603671] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62a92b8-4863-4e9d-809d-e8687b429f2a in Status: IN_PROGRESS for 2s [ 884.618570] env[71140]: INFO networking_nsxv3.common.synchronization [None req-fd3da929-47a2-49bf-9fbb-f799f6c611a7 tempest-ServerRescueNegativeTestJSON-432250818 tempest-ServerRescueNegativeTestJSON-432250818-project-member] Enqueued Resource ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d with Priority: HIGHEST for action security_group_rules [ 884.618570] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d with Priority: HIGHEST for action security_group_rules [ 884.618570] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.622607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.622607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.622607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.622607] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f8a236-f7eb-4e78-a4ac-ee225ba9532d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.704860] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.705122] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-354" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.705200] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-354" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.705471] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-354" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.705744] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.705906] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.706727] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.706727] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.706840] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.707903] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.707903] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.707903] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.707903] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.707903] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.707903] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.707903] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.713754] env[71140]: INFO networking_nsxv3.common.synchronization [None req-1792e5e5-c361-40fb-b10f-35c1867c23dd tempest-ServerRescueNegativeTestJSON-432250818 tempest-ServerRescueNegativeTestJSON-432250818-project-member] Enqueued Resource ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d with Priority: HIGHEST for action security_group_rules [ 884.714426] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d with Priority: HIGHEST for action security_group_rules [ 884.714748] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.714846] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.728618] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.728883] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 884.728993] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.730563] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-354" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.730563] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-2c76f721-c39b-4414-bfb3-0fccf35fa590 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.730563] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-2c76f721-c39b-4414-bfb3-0fccf35fa590" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.730563] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-2c76f721-c39b-4414-bfb3-0fccf35fa590" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.730563] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-2c76f721-c39b-4414-bfb3-0fccf35fa590" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.730563] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c76f721-c39b-4414-bfb3-0fccf35fa590',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.911946] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 884.912230] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.912408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.912662] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.912854] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.912974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.913067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.913239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.913325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.913425] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.146699] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.147161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.147161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.151025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.151025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.151025] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d already deleted. [ 885.151025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.151025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.151025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.151025] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f8a236-f7eb-4e78-a4ac-ee225ba9532d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.235078] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.235963] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.235963] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.236600] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.237925] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.237925] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 2c76f721-c39b-4414-bfb3-0fccf35fa590 not found, creating... [ 885.237925] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.237925] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.237925] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.238299] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.238602] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.239139] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.239935] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.242813] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.242813] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.242813] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.242813] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 2c76f721-c39b-4414-bfb3-0fccf35fa590 is going to be created. [ 885.262031] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.263031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.263031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.263031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.263031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.263624] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-2c76f721-c39b-4414-bfb3-0fccf35fa590" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.417353] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.673301] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.673470] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.673561] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.674820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.674820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.674820] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d already deleted. [ 885.674820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.918924] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.083022] env[71140]: INFO networking_nsxv3.common.synchronization [req-404a542d-c5d1-4eca-8394-87152a2ceeae req-eb012e93-7330-4fec-ae98-1a2fe544776e service nova] Enqueued Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_rules [ 886.083022] env[71140]: INFO networking_nsxv3.common.synchronization [req-404a542d-c5d1-4eca-8394-87152a2ceeae req-eb012e93-7330-4fec-ae98-1a2fe544776e service nova] Enqueued Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_members [ 886.083022] env[71140]: INFO networking_nsxv3.common.synchronization [req-404a542d-c5d1-4eca-8394-87152a2ceeae req-eb012e93-7330-4fec-ae98-1a2fe544776e service nova] Enqueued Resource ID: 2c76f721-c39b-4414-bfb3-0fccf35fa590 with Priority: HIGHEST for action port [ 886.083022] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_rules [ 886.083022] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_members [ 886.083022] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c76f721-c39b-4414-bfb3-0fccf35fa590 with Priority: HIGHEST for action port [ 886.083022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c62a92b8-4863-4e9d-809d-e8687b429f2a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.083022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.084302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.084525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.084616] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.087474] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62a92b8-4863-4e9d-809d-e8687b429f2a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.087474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.087474] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c76f721-c39b-4414-bfb3-0fccf35fa590 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.087474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c76f721-c39b-4414-bfb3-0fccf35fa590" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.087474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c76f721-c39b-4414-bfb3-0fccf35fa590" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.087474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c76f721-c39b-4414-bfb3-0fccf35fa590" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.087474] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c76f721-c39b-4414-bfb3-0fccf35fa590',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.362673] env[71140]: INFO networking_nsxv3.common.synchronization [req-fc93d6b1-c2fc-4062-b40c-071eb57d090e req-0a35e629-7443-4208-a164-44abbe52e4a7 tempest-ServerMetadataNegativeTestJSON-1453221679 tempest-ServerMetadataNegativeTestJSON-1453221679-project-member] Enqueued Resource ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a with Priority: HIGHEST for action security_group_members [ 886.362673] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a with Priority: HIGHEST for action security_group_members [ 886.364729] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.365050] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.365264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.365682] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.365940] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.366197] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.367025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.367025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.367025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.367025] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3e5dc50-8f82-494d-8a76-86f2e68a6f6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.425585] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.425585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.425585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.425585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.425585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.425585] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be updated. [ 886.455207] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.455207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.455207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.455207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.455207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.470249] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: IN_PROGRESS for 2s [ 886.591026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62a92b8-4863-4e9d-809d-e8687b429f2a taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.591026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.591026] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c76f721-c39b-4414-bfb3-0fccf35fa590 with status ACTIVE [ 886.591026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.591026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.591026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.591026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.591026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.591026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.591026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.591026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.591026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.591026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.591774] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.591774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.591774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.591774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.591774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.591774] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c76f721-c39b-4414-bfb3-0fccf35fa590 is going to be updated. [ 886.614393] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62a92b8-4863-4e9d-809d-e8687b429f2a in Status: SUCCESS [ 886.614393] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c62a92b8-4863-4e9d-809d-e8687b429f2a deletion is rescheduled due to dependency. [ 886.614393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.614393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.614393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.614393] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.614393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.614393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.614393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.614393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.614393] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.619528] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.619528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.619528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.619918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.620416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.620509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c76f721-c39b-4414-bfb3-0fccf35fa590" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.870308] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.870697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.871478] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.871478] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.871478] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.871478] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.871701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.871701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.872541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.872541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.872541] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a is going to be updated. [ 886.901555] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.901713] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.902846] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.902846] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.902846] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.912109] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a in Status: IN_PROGRESS for 2s [ 887.117853] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.621127] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.125013] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.125228] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.125305] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.125525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.125619] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.125722] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c62a92b8-4863-4e9d-809d-e8687b429f2a is going to be updated. [ 888.151712] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.151861] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.151932] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.152171] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.152313] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.159594] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62a92b8-4863-4e9d-809d-e8687b429f2a in Status: IN_PROGRESS for 2s [ 888.481367] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 888.481475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.481815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.481980] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.482340] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.482629] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.482701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.482984] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.483103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.483196] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.483294] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.484359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.484530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.484860] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.484860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.484971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.485121] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.485198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.485285] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.922790] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a in Status: SUCCESS [ 888.923184] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3e5dc50-8f82-494d-8a76-86f2e68a6f6a deletion is rescheduled due to dependency. [ 888.923184] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e5dc50-8f82-494d-8a76-86f2e68a6f6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.986863] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.987114] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.987323] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.491199] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.038213] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.038213] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.038213] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.038213] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.038213] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.038213] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be updated. [ 890.047205] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.047359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.047428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.048307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.048307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.065177] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: IN_PROGRESS for 2s [ 890.171212] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62a92b8-4863-4e9d-809d-e8687b429f2a in Status: SUCCESS [ 890.171212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.171212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.171212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.171212] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.171212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.171749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.171749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.171749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.171749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.171862] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.674874] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.178522] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c62a92b8-4863-4e9d-809d-e8687b429f2a: rpc.has_security_group_logging(os_id): False [ 891.195228] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.195382] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.195454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.195680] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.195769] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.196021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.196130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.196198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.196355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.196431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.196518] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c62a92b8-4863-4e9d-809d-e8687b429f2a is going to be updated. [ 891.253543] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.253679] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.253753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.253974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.254146] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.264675] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c62a92b8-4863-4e9d-809d-e8687b429f2a in Status: IN_PROGRESS for 2s [ 891.365487] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 891.365487] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 892.071527] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 892.071834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.072046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.072775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.072775] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.072929] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.072971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.073173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.073254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.073566] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.073566] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.073692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.073765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.073946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.074107] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.074234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.074301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.074445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.074550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.074641] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.074805] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.578016] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e: rpc.has_security_group_logging(os_id): False [ 892.594664] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.594823] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.594898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.595141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.595989] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.595989] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.595989] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.595989] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.595989] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.595989] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.595989] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.596951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.596951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.596951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.596951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.596951] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.596951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.596951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.596951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.596951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.596951] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be updated. [ 892.666994] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.666994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.667256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.667256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.667412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.681097] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: IN_PROGRESS for 2s [ 892.729730] env[71140]: INFO networking_nsxv3.common.synchronization [req-8c4b4bba-74cf-482a-b75c-e08a88dab670 req-16bfd7b7-3e63-47e4-90c1-fbc12136e890 tempest-FloatingIPsAssociationTestJSON-945479351 tempest-FloatingIPsAssociationTestJSON-945479351-project-member] Enqueued Resource ID: f9ec394c-128b-4456-9eb1-76442418ea09 with Priority: HIGHEST for action security_group_members [ 892.730398] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ec394c-128b-4456-9eb1-76442418ea09 with Priority: HIGHEST for action security_group_members [ 892.730801] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9ec394c-128b-4456-9eb1-76442418ea09 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.730883] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.730997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.733537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.733705] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.733811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.733876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.734150] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.734298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.734409] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9ec394c-128b-4456-9eb1-76442418ea09',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.238133] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.238133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.238133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.241719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.261200] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.261455] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.263101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.263101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.263101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.263101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.263101] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9ec394c-128b-4456-9eb1-76442418ea09 is going to be updated. [ 893.276418] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c62a92b8-4863-4e9d-809d-e8687b429f2a in Status: SUCCESS [ 893.277370] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.286529] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.286657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.286698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.286926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.287136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.296018] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9ec394c-128b-4456-9eb1-76442418ea09 in Status: IN_PROGRESS for 2s [ 893.535880] env[71140]: INFO networking_nsxv3.common.synchronization [None req-d05d2145-857a-44ce-9252-6c4688f94b78 tempest-AttachVolumeNegativeTest-950002537 tempest-AttachVolumeNegativeTest-950002537-project-member] Enqueued Resource ID: e42db4b7-b71b-4297-acb7-b4910e7af664 with Priority: HIGHEST for action security_group_rules [ 893.536742] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42db4b7-b71b-4297-acb7-b4910e7af664 with Priority: HIGHEST for action security_group_rules [ 893.536787] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e42db4b7-b71b-4297-acb7-b4910e7af664 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.537100] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.537100] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.537309] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.537429] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e42db4b7-b71b-4297-acb7-b4910e7af664',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.635031] env[71140]: INFO networking_nsxv3.common.synchronization [None req-ceacafac-a70a-4466-914e-5f2f6c829d36 tempest-AttachVolumeNegativeTest-950002537 tempest-AttachVolumeNegativeTest-950002537-project-member] Enqueued Resource ID: e42db4b7-b71b-4297-acb7-b4910e7af664 with Priority: HIGHEST for action security_group_rules [ 893.635031] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42db4b7-b71b-4297-acb7-b4910e7af664 with Priority: HIGHEST for action security_group_rules [ 893.635330] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e42db4b7-b71b-4297-acb7-b4910e7af664 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.635330] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.057443] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.057613] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.057696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.057895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.057990] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.058124] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42db4b7-b71b-4297-acb7-b4910e7af664 already deleted. [ 894.058216] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.058370] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.058646] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.058646] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e42db4b7-b71b-4297-acb7-b4910e7af664',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.579924] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.580126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.580206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.580443] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.580542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.580642] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42db4b7-b71b-4297-acb7-b4910e7af664 already deleted. [ 894.580724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.696055] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 894.696339] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.697456] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.697456] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.697456] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.199783] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.199956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.200048] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.200285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.200460] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.200554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.200618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.200769] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.200858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.200946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.201049] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.303390] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9ec394c-128b-4456-9eb1-76442418ea09 in Status: SUCCESS [ 895.303604] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9ec394c-128b-4456-9eb1-76442418ea09 deletion is rescheduled due to dependency. [ 895.303721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9ec394c-128b-4456-9eb1-76442418ea09" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.703934] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.704408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.704408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.704471] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.704608] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.704738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.704806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.705020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.705106] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.705204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.705371] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.705613] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.705613] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.705766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.705836] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.705915] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.705971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.706128] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.706280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.706365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.706462] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.210131] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e: rpc.has_security_group_logging(os_id): False [ 896.227493] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.227670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.227705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.228654] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.228654] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.228654] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.228654] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.228654] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.228654] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.228654] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.229098] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.229098] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.229098] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.229098] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.229348] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.229389] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.229450] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.229500] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.229644] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.229715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.229799] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be updated. [ 896.283058] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.283212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.283292] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.283513] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.283708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.297551] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: IN_PROGRESS for 2s [ 897.593237] env[71140]: INFO networking_nsxv3.common.synchronization [req-7e7e6182-27f1-491f-9a85-257bdfa17d71 req-3b0e1bf7-86aa-4d4a-88d5-d2ffbf4c4f89 tempest-ServersTestMultiNic-1825947710 tempest-ServersTestMultiNic-1825947710-project-member] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 897.593822] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 897.594300] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.594476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.594549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.594753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.594909] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.595012] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.599642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.599642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.599642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.599642] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.845448] env[71140]: INFO networking_nsxv3.common.synchronization [req-7e7e6182-27f1-491f-9a85-257bdfa17d71 req-050f7f9d-edc0-4be7-a3e1-ff4031e85630 tempest-ServersTestMultiNic-1825947710 tempest-ServersTestMultiNic-1825947710-project-member] Enqueued Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 897.846058] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e with Priority: HIGHEST for action security_group_members [ 897.846454] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.846562] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.105188] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.238058] env[71140]: INFO networking_nsxv3.common.synchronization [req-2fb71a66-d475-4a49-9176-53f4f82e2004 req-abecae4a-9cd8-4096-905d-24462e92a1da tempest-ServersAdminTestJSON-2080308680 tempest-ServersAdminTestJSON-2080308680-project-member] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 898.238885] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 898.239169] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.239393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.239509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.239728] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.239912] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.240055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.240139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.240325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.240412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.240554] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.315557] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 898.315557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.608027] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.743248] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.110764] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.110764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.110916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.111032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.111131] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.111290] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be updated. [ 899.149671] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.149671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.149671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.149671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.149859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.159523] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: IN_PROGRESS for 2s [ 899.245368] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.749441] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.749743] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.749743] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.750919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.750919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.750919] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be updated. [ 899.780887] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.781052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.781129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.781340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.781481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.792881] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: IN_PROGRESS for 2s [ 901.176154] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 901.176488] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.177545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.177545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.177545] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.177545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.177545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.177545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.177545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.177545] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40b2250b-502e-4365-a6ba-2ea8c2fa6c5e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.684734] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.684920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.685015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.685246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.685337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.685537] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.685634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.685696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.685851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.685928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.686022] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e is going to be updated. [ 901.714673] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.714811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.714912] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.715156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.715304] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.723154] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: IN_PROGRESS for 2s [ 901.809647] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: SUCCESS [ 901.809873] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.239856] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 903.239856] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 903.735580] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e in Status: SUCCESS [ 903.735670] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40b2250b-502e-4365-a6ba-2ea8c2fa6c5e deletion is rescheduled due to dependency. [ 903.736430] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40b2250b-502e-4365-a6ba-2ea8c2fa6c5e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.267079] env[71140]: INFO networking_nsxv3.common.synchronization [req-87262477-22ea-41db-b99b-8d4104d57376 req-77d738fe-7502-4e2c-a58a-c11dd80799ad tempest-MigrationsAdminTest-2143534678 tempest-MigrationsAdminTest-2143534678-project-member] Enqueued Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGHEST for action security_group_members [ 904.267646] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGHEST for action security_group_members [ 904.268012] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.268185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.268185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.268362] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.268487] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.268585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.268646] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.268787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.268871] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.268964] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.775721] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.278676] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.783222] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.783222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.783222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.783222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.783222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.783222] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0021f162-837d-4356-afbf-4e10e33828d6 is going to be updated. [ 905.822272] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.822272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.822272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.822272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.822272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.832626] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0021f162-837d-4356-afbf-4e10e33828d6 in Status: IN_PROGRESS for 2s [ 907.842971] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0021f162-837d-4356-afbf-4e10e33828d6 in Status: SUCCESS [ 907.843276] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.271394] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 909.271767] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 909.405802] env[71140]: INFO networking_nsxv3.common.synchronization [req-a62f77a0-e52c-4ab7-a114-45477dbd1eb8 req-095bba6b-53bc-4f78-b3af-1ae5dbcc2141 tempest-ServersTestJSON-593331045 tempest-ServersTestJSON-593331045-project-member] Enqueued Resource ID: a6eb3617-ce46-425c-b053-a5240fa9c14e with Priority: HIGHEST for action security_group_members [ 909.406390] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6eb3617-ce46-425c-b053-a5240fa9c14e with Priority: HIGHEST for action security_group_members [ 909.406725] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6eb3617-ce46-425c-b053-a5240fa9c14e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.406855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.406917] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.407368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.408028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.408028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.408028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.408028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.408028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.408490] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6eb3617-ce46-425c-b053-a5240fa9c14e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.911973] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.911973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.911973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.911973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.911973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.911973] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.911973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.911973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.911973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.911973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.911973] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6eb3617-ce46-425c-b053-a5240fa9c14e already deleted. [ 909.911973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.987051] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-425 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.987051] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-425" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.987051] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-425" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.987051] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-425" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.987051] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.987459] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.987707] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.988095] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.988407] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.988760] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 909.989023] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 909.989253] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 909.989520] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 909.989793] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 909.990038] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 909.990318] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.009863] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.010304] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 910.010586] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.010891] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-425" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.011353] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-546ec2e9-c015-4932-9edb-6341c129a7da taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.012025] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-546ec2e9-c015-4932-9edb-6341c129a7da" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.012025] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-546ec2e9-c015-4932-9edb-6341c129a7da" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.012381] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-546ec2e9-c015-4932-9edb-6341c129a7da" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.012659] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('546ec2e9-c015-4932-9edb-6341c129a7da',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.515307] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.515645] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.519288] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.519595] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.519756] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.519922] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 546ec2e9-c015-4932-9edb-6341c129a7da not found, creating... [ 910.520255] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.520466] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.520652] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.520915] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.521106] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.522594] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.522933] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.523204] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.523552] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.523873] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.524184] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 546ec2e9-c015-4932-9edb-6341c129a7da is going to be created. [ 910.545487] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.545720] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.545904] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.546308] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.546576] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.546845] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-546ec2e9-c015-4932-9edb-6341c129a7da" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.119844] env[71140]: INFO networking_nsxv3.common.synchronization [None req-be95460d-687b-4d5c-987b-3b967067bb29 None None] Enqueued Resource ID: 8e07d2a0-d010-420f-970f-0e054bff5630 with Priority: HIGHEST for action port [ 911.120100] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e07d2a0-d010-420f-970f-0e054bff5630 with Priority: HIGHEST for action port [ 911.120787] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e07d2a0-d010-420f-970f-0e054bff5630 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.120991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e07d2a0-d010-420f-970f-0e054bff5630" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.120991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e07d2a0-d010-420f-970f-0e054bff5630" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.121178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e07d2a0-d010-420f-970f-0e054bff5630" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.121256] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e07d2a0-d010-420f-970f-0e054bff5630',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.499439] env[71140]: INFO networking_nsxv3.common.synchronization [req-a62f77a0-e52c-4ab7-a114-45477dbd1eb8 req-7551309d-049e-4f1b-b21d-67bfc43b03ee service nova] Enqueued Resource ID: a6eb3617-ce46-425c-b053-a5240fa9c14e with Priority: HIGHEST for action security_group_rules [ 911.499439] env[71140]: INFO networking_nsxv3.common.synchronization [req-a62f77a0-e52c-4ab7-a114-45477dbd1eb8 req-7551309d-049e-4f1b-b21d-67bfc43b03ee service nova] Enqueued Resource ID: a6eb3617-ce46-425c-b053-a5240fa9c14e with Priority: HIGHEST for action security_group_members [ 911.499439] env[71140]: INFO networking_nsxv3.common.synchronization [req-a62f77a0-e52c-4ab7-a114-45477dbd1eb8 req-7551309d-049e-4f1b-b21d-67bfc43b03ee service nova] Enqueued Resource ID: 546ec2e9-c015-4932-9edb-6341c129a7da with Priority: HIGHEST for action port [ 911.499439] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6eb3617-ce46-425c-b053-a5240fa9c14e with Priority: HIGHEST for action security_group_rules [ 911.499439] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6eb3617-ce46-425c-b053-a5240fa9c14e with Priority: HIGHEST for action security_group_members [ 911.499439] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546ec2e9-c015-4932-9edb-6341c129a7da with Priority: HIGHEST for action port [ 911.499439] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6eb3617-ce46-425c-b053-a5240fa9c14e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.500180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.500871] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.501113] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.501199] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6eb3617-ce46-425c-b053-a5240fa9c14e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.502138] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6eb3617-ce46-425c-b053-a5240fa9c14e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.502256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.502323] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.502502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.502677] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.502748] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.502811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.502956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.503060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.503150] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6eb3617-ce46-425c-b053-a5240fa9c14e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.504307] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-546ec2e9-c015-4932-9edb-6341c129a7da taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.504575] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-546ec2e9-c015-4932-9edb-6341c129a7da" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.504683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-546ec2e9-c015-4932-9edb-6341c129a7da" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.504898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-546ec2e9-c015-4932-9edb-6341c129a7da" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.505047] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('546ec2e9-c015-4932-9edb-6341c129a7da',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.626208] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e07d2a0-d010-420f-970f-0e054bff5630 [ 911.626492] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.626583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.626892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.626892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.627027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.627135] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e07d2a0-d010-420f-970f-0e054bff5630 already deleted. [ 911.627223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e07d2a0-d010-420f-970f-0e054bff5630" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.009257] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6eb3617-ce46-425c-b053-a5240fa9c14e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.009257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.009257] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6eb3617-ce46-425c-b053-a5240fa9c14e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.009257] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 546ec2e9-c015-4932-9edb-6341c129a7da with status ACTIVE [ 912.009257] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.009257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.009257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.009257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.009257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.009257] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.009257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.009257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.009257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.009257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.009746] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.009746] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.009746] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.009746] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.009873] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.009873] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 546ec2e9-c015-4932-9edb-6341c129a7da is going to be updated. [ 912.034693] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.035522] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.035610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.036853] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.036853] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.036853] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-546ec2e9-c015-4932-9edb-6341c129a7da" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.183904] env[71140]: INFO networking_nsxv3.common.synchronization [None req-192b5656-c788-48d2-831d-86d48688aea4 tempest-ServerActionsTestJSON-2079743708 tempest-ServerActionsTestJSON-2079743708-project-member] Enqueued Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_rules [ 912.184128] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_rules [ 912.184870] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.184870] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.184870] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.185157] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.185303] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.279934] env[71140]: INFO networking_nsxv3.common.synchronization [None req-39049ceb-cab4-4305-a2a3-20f521b94dad tempest-ServerActionsTestJSON-2079743708 tempest-ServerActionsTestJSON-2079743708-project-member] Enqueued Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_rules [ 912.280240] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_rules [ 912.280537] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.280638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.515749] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6eb3617-ce46-425c-b053-a5240fa9c14e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.713084] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.713084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.713084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.713084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.713084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.713084] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 already deleted. [ 912.713084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.713084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.713084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.713084] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.021036] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.021036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.021036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.021036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.021036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.021036] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6eb3617-ce46-425c-b053-a5240fa9c14e is going to be created. [ 913.044386] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.044386] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.044386] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.044386] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.044386] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.052827] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6eb3617-ce46-425c-b053-a5240fa9c14e in Status: UNINITIALIZED for 2s [ 913.233694] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.233899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.233997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.234343] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.234448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.234551] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 already deleted. [ 913.234669] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.250718] env[71140]: INFO networking_nsxv3.common.synchronization [None req-26a58e4e-d744-48bc-afbd-c3da379e0fa2 None None] Enqueued Resource ID: 55ece9bf-cac1-4022-941a-f98c9af29ba9 with Priority: HIGHEST for action port [ 913.251436] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55ece9bf-cac1-4022-941a-f98c9af29ba9 with Priority: HIGHEST for action port [ 913.251672] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-55ece9bf-cac1-4022-941a-f98c9af29ba9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.251841] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55ece9bf-cac1-4022-941a-f98c9af29ba9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.251897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55ece9bf-cac1-4022-941a-f98c9af29ba9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.252205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55ece9bf-cac1-4022-941a-f98c9af29ba9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.252294] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55ece9bf-cac1-4022-941a-f98c9af29ba9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.756403] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55ece9bf-cac1-4022-941a-f98c9af29ba9 [ 913.756768] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.756868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.756938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.757182] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.757282] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.757833] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55ece9bf-cac1-4022-941a-f98c9af29ba9 already deleted. [ 913.757833] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55ece9bf-cac1-4022-941a-f98c9af29ba9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.063568] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6eb3617-ce46-425c-b053-a5240fa9c14e in Status: SUCCESS [ 915.065142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.065413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.065585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.065787] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.065910] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.065976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.068435] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.068435] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.068435] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.068435] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6eb3617-ce46-425c-b053-a5240fa9c14e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.571602] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6eb3617-ce46-425c-b053-a5240fa9c14e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.074216] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6eb3617-ce46-425c-b053-a5240fa9c14e: rpc.has_security_group_logging(os_id): False [ 916.096026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.096026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.096026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.096026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.096026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.096026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.096026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.096026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.096026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.096026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.096026] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6eb3617-ce46-425c-b053-a5240fa9c14e is going to be created. [ 916.155209] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.155209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.155209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.155209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.155209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.164277] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6eb3617-ce46-425c-b053-a5240fa9c14e in Status: IN_PROGRESS for 2s [ 918.176688] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6eb3617-ce46-425c-b053-a5240fa9c14e in Status: SUCCESS [ 918.176969] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.252058] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 918.252213] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 921.914671] env[71140]: INFO networking_nsxv3.common.synchronization [None req-747ede99-4ec4-4fdc-8e46-f72b948d9553 None None] Enqueued Resource ID: 677303df-be6d-4ad1-bf74-f86fb68e6703 with Priority: HIGHEST for action port [ 921.916380] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 677303df-be6d-4ad1-bf74-f86fb68e6703 with Priority: HIGHEST for action port [ 921.916380] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-677303df-be6d-4ad1-bf74-f86fb68e6703 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.916380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-677303df-be6d-4ad1-bf74-f86fb68e6703" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.917154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-677303df-be6d-4ad1-bf74-f86fb68e6703" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.917817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-677303df-be6d-4ad1-bf74-f86fb68e6703" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.919644] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('677303df-be6d-4ad1-bf74-f86fb68e6703',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.072361] env[71140]: INFO networking_nsxv3.common.synchronization [req-f087edf9-8a87-4c71-acaa-e6daf0bd722e req-3b66801e-bf6c-4992-a303-35c3be8d0fab tempest-ServerRescueNegativeTestJSON-432250818 tempest-ServerRescueNegativeTestJSON-432250818-project-member] Enqueued Resource ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d with Priority: HIGHEST for action security_group_members [ 922.072361] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d with Priority: HIGHEST for action security_group_members [ 922.072361] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.072361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.072361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.072361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.073736] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.074872] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.075090] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.075413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.076330] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.076330] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f8a236-f7eb-4e78-a4ac-ee225ba9532d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.421161] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 677303df-be6d-4ad1-bf74-f86fb68e6703 [ 922.421405] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.421567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.421656] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.421898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.422026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.422350] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:677303df-be6d-4ad1-bf74-f86fb68e6703 already deleted. [ 922.422462] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-677303df-be6d-4ad1-bf74-f86fb68e6703" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.581312] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.581312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.581312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.581312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.581312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.582496] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.582496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.582496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.582496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.582496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.582496] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d already deleted. [ 922.582795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.654699] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-99 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.654699] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.654699] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.654932] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.655207] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.655360] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.655475] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.655688] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.655829] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.656662] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 922.656662] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.656662] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.656662] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.656662] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 922.656834] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.656988] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.679018] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.679018] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 922.679018] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.679018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.679018] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-51d77220-c152-4a58-bc0d-a17405a72136 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.679018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-51d77220-c152-4a58-bc0d-a17405a72136" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.679018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-51d77220-c152-4a58-bc0d-a17405a72136" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.679018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-51d77220-c152-4a58-bc0d-a17405a72136" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.679018] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51d77220-c152-4a58-bc0d-a17405a72136',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.181197] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.181502] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.181551] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.181789] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.182144] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.183217] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 51d77220-c152-4a58-bc0d-a17405a72136 not found, creating... [ 923.184290] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.184290] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.184290] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.184445] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.184528] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.186091] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.186091] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.186091] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.186091] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.186091] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.186091] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 51d77220-c152-4a58-bc0d-a17405a72136 is going to be created. [ 923.205256] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.205256] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.205256] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.205509] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.206137] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.206137] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-51d77220-c152-4a58-bc0d-a17405a72136" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.081563] env[71140]: INFO networking_nsxv3.common.synchronization [req-f087edf9-8a87-4c71-acaa-e6daf0bd722e req-c9c6651c-69b3-45a3-81eb-1be2682bdbab service nova] Enqueued Resource ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d with Priority: HIGHEST for action security_group_rules [ 924.083171] env[71140]: INFO networking_nsxv3.common.synchronization [req-f087edf9-8a87-4c71-acaa-e6daf0bd722e req-c9c6651c-69b3-45a3-81eb-1be2682bdbab service nova] Enqueued Resource ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d with Priority: HIGHEST for action security_group_members [ 924.083171] env[71140]: INFO networking_nsxv3.common.synchronization [req-f087edf9-8a87-4c71-acaa-e6daf0bd722e req-c9c6651c-69b3-45a3-81eb-1be2682bdbab service nova] Enqueued Resource ID: 51d77220-c152-4a58-bc0d-a17405a72136 with Priority: HIGHEST for action port [ 924.083171] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d with Priority: HIGHEST for action security_group_rules [ 924.083171] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d with Priority: HIGHEST for action security_group_members [ 924.083171] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d77220-c152-4a58-bc0d-a17405a72136 with Priority: HIGHEST for action port [ 924.083171] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.083802] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.083932] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.087538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.087538] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f8a236-f7eb-4e78-a4ac-ee225ba9532d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.087538] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.087538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.087538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.087538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.087538] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.087538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.087538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.087538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.087538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.087538] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f8a236-f7eb-4e78-a4ac-ee225ba9532d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.087538] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-51d77220-c152-4a58-bc0d-a17405a72136 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.087538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51d77220-c152-4a58-bc0d-a17405a72136" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.087538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51d77220-c152-4a58-bc0d-a17405a72136" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.087538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51d77220-c152-4a58-bc0d-a17405a72136" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.087538] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51d77220-c152-4a58-bc0d-a17405a72136',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.562272] env[71140]: INFO networking_nsxv3.common.synchronization [None req-02876892-b41e-4609-b78e-ecd79bd21ffa None None] Enqueued Resource ID: 8a8b3a23-8f4d-4b87-83ad-21d78704deb5 with Priority: HIGHEST for action port [ 924.562856] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a8b3a23-8f4d-4b87-83ad-21d78704deb5 with Priority: HIGHEST for action port [ 924.563289] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a8b3a23-8f4d-4b87-83ad-21d78704deb5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.563504] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a8b3a23-8f4d-4b87-83ad-21d78704deb5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.563809] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a8b3a23-8f4d-4b87-83ad-21d78704deb5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.564200] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a8b3a23-8f4d-4b87-83ad-21d78704deb5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.564431] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a8b3a23-8f4d-4b87-83ad-21d78704deb5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.589643] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00f8a236-f7eb-4e78-a4ac-ee225ba9532d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.590981] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.591113] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.591270] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51d77220-c152-4a58-bc0d-a17405a72136 with status ACTIVE [ 924.591446] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.591552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.591633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.592219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.592219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.592219] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.592219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.592372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.592473] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.592589] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.592765] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.592884] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.592947] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.593327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.593493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.594011] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51d77220-c152-4a58-bc0d-a17405a72136 is going to be updated. [ 924.613722] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.613864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.613939] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.614187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.614325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.614485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51d77220-c152-4a58-bc0d-a17405a72136" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.758680] env[71140]: INFO networking_nsxv3.common.synchronization [req-5fc0fe74-1b06-4b7d-8ca7-576abff048f2 req-6aa0a1ea-5c60-47b4-aaf6-12aa7365a999 tempest-AttachVolumeNegativeTest-950002537 tempest-AttachVolumeNegativeTest-950002537-project-member] Enqueued Resource ID: e42db4b7-b71b-4297-acb7-b4910e7af664 with Priority: HIGHEST for action security_group_members [ 924.760049] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42db4b7-b71b-4297-acb7-b4910e7af664 with Priority: HIGHEST for action security_group_members [ 924.761468] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42db4b7-b71b-4297-acb7-b4910e7af664 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.764274] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.764357] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.764614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.764802] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.764919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.765010] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.765298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.765816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.765816] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42db4b7-b71b-4297-acb7-b4910e7af664',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.066800] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a8b3a23-8f4d-4b87-83ad-21d78704deb5 [ 925.066800] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.066965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.066965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.067287] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.067557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.067557] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a8b3a23-8f4d-4b87-83ad-21d78704deb5 already deleted. [ 925.067557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a8b3a23-8f4d-4b87-83ad-21d78704deb5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.096157] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00f8a236-f7eb-4e78-a4ac-ee225ba9532d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.268633] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.268945] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.268945] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.269099] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.269222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.269421] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.269521] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.269585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.269848] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.269848] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.270019] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42db4b7-b71b-4297-acb7-b4910e7af664 already deleted. [ 925.270019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.312586] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-838 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.312586] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-838" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.312586] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-838" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.312586] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-838" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.312586] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.312586] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.312586] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.314033] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.314127] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.314275] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.314396] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.314504] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.314834] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.314834] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.314834] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.315030] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.331674] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.331856] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 925.331999] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.332228] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-838" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.332528] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.332705] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.332828] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.333208] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.333357] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.600195] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.600527] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.600527] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.600661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.600785] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.600900] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d is going to be created. [ 925.625586] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.625709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.625772] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.625986] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.626183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.637157] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d in Status: UNINITIALIZED for 2s [ 925.837699] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.837699] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.837699] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.837699] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.837699] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.837699] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080 not found, creating... [ 925.837699] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.837699] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.837699] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.838244] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.838244] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.838935] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.839117] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.839269] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.839516] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.839995] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.840209] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080 is going to be created. [ 925.860943] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.861182] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.861182] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.861416] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.861640] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.861864] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.387249] env[71140]: INFO networking_nsxv3.common.synchronization [None req-0f3b338a-e433-4d56-9224-86687d78854d None None] Enqueued Resource ID: 6e479c26-8d39-41a1-983f-909d5ad7ed0b with Priority: HIGHEST for action port [ 926.387249] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e479c26-8d39-41a1-983f-909d5ad7ed0b with Priority: HIGHEST for action port [ 926.387249] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e479c26-8d39-41a1-983f-909d5ad7ed0b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.387249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e479c26-8d39-41a1-983f-909d5ad7ed0b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.387249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e479c26-8d39-41a1-983f-909d5ad7ed0b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.387249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e479c26-8d39-41a1-983f-909d5ad7ed0b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.387249] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e479c26-8d39-41a1-983f-909d5ad7ed0b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.888174] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e479c26-8d39-41a1-983f-909d5ad7ed0b [ 926.888174] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.888174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.888174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.888174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.888174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.888174] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e479c26-8d39-41a1-983f-909d5ad7ed0b already deleted. [ 926.888174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e479c26-8d39-41a1-983f-909d5ad7ed0b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.907318] env[71140]: INFO networking_nsxv3.common.synchronization [req-5fc0fe74-1b06-4b7d-8ca7-576abff048f2 req-e2383900-28b9-4afa-a6b9-3023e941ce00 service nova] Enqueued Resource ID: e42db4b7-b71b-4297-acb7-b4910e7af664 with Priority: HIGHEST for action security_group_rules [ 926.907492] env[71140]: INFO networking_nsxv3.common.synchronization [req-5fc0fe74-1b06-4b7d-8ca7-576abff048f2 req-e2383900-28b9-4afa-a6b9-3023e941ce00 service nova] Enqueued Resource ID: e42db4b7-b71b-4297-acb7-b4910e7af664 with Priority: HIGHEST for action security_group_members [ 926.907636] env[71140]: INFO networking_nsxv3.common.synchronization [req-5fc0fe74-1b06-4b7d-8ca7-576abff048f2 req-e2383900-28b9-4afa-a6b9-3023e941ce00 service nova] Enqueued Resource ID: dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080 with Priority: HIGHEST for action port [ 926.907857] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42db4b7-b71b-4297-acb7-b4910e7af664 with Priority: HIGHEST for action security_group_rules [ 926.907984] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42db4b7-b71b-4297-acb7-b4910e7af664 with Priority: HIGHEST for action security_group_members [ 926.908099] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080 with Priority: HIGHEST for action port [ 926.909087] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e42db4b7-b71b-4297-acb7-b4910e7af664 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.909087] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.909087] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.909087] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.909391] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e42db4b7-b71b-4297-acb7-b4910e7af664',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.910220] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42db4b7-b71b-4297-acb7-b4910e7af664 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.913028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.913028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.913028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.913028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.913028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.913028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.913028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.913028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.913028] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42db4b7-b71b-4297-acb7-b4910e7af664',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.914047] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.914153] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.914227] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.914373] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.914451] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.416017] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42db4b7-b71b-4297-acb7-b4910e7af664',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.418472] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42db4b7-b71b-4297-acb7-b4910e7af664 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.418639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.419064] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080 with status ACTIVE [ 927.423026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.423026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.423026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.423026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.423026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.423026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.423026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.423026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.423026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.423026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.423026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.423026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.423026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.423026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.423026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.423530] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080 is going to be updated. [ 927.443097] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.443265] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.443325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.443536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.443677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.443843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc3c3bf4-b274-4f03-ab5c-38c4ee8b2080" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.646097] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d in Status: SUCCESS [ 927.647726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.647726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.647726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.647726] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.647726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.647726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.647726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.647726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.647726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.647726] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00f8a236-f7eb-4e78-a4ac-ee225ba9532d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.920575] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42db4b7-b71b-4297-acb7-b4910e7af664',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.150550] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00f8a236-f7eb-4e78-a4ac-ee225ba9532d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.317355] env[71140]: INFO networking_nsxv3.common.synchronization [None req-b46b17ce-c37a-4ca5-a53a-657a274bcb14 None None] Enqueued Resource ID: 6074c515-87b7-4014-985b-fcd5ba2d4ce3 with Priority: HIGHEST for action port [ 928.317934] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6074c515-87b7-4014-985b-fcd5ba2d4ce3 with Priority: HIGHEST for action port [ 928.318282] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-6074c515-87b7-4014-985b-fcd5ba2d4ce3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.318431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6074c515-87b7-4014-985b-fcd5ba2d4ce3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.318479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6074c515-87b7-4014-985b-fcd5ba2d4ce3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.318751] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6074c515-87b7-4014-985b-fcd5ba2d4ce3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.318832] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6074c515-87b7-4014-985b-fcd5ba2d4ce3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.423640] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.426669] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.426669] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.426669] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.426669] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.426669] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42db4b7-b71b-4297-acb7-b4910e7af664 is going to be created. [ 928.450472] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.450472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.450472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.450472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.450472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.462032] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42db4b7-b71b-4297-acb7-b4910e7af664 in Status: UNINITIALIZED for 2s [ 928.656042] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00f8a236-f7eb-4e78-a4ac-ee225ba9532d: rpc.has_security_group_logging(os_id): False [ 928.672586] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.672586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.672586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.672586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.672586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.672586] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.672586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.672586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.672586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.672586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.672586] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d is going to be created. [ 928.728484] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.728484] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.728484] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.728666] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.728904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.739233] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d in Status: IN_PROGRESS for 2s [ 928.752883] env[71140]: INFO networking_nsxv3.common.synchronization [None req-0b7beadc-cba5-41af-a4e5-8562ddda8de8 None None] Enqueued Resource ID: 510642af-18db-48db-b1f9-aaba1f259c1a with Priority: HIGHEST for action port [ 928.753180] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 510642af-18db-48db-b1f9-aaba1f259c1a with Priority: HIGHEST for action port [ 928.753764] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-510642af-18db-48db-b1f9-aaba1f259c1a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.753905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-510642af-18db-48db-b1f9-aaba1f259c1a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.753961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-510642af-18db-48db-b1f9-aaba1f259c1a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.754209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-510642af-18db-48db-b1f9-aaba1f259c1a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.754294] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('510642af-18db-48db-b1f9-aaba1f259c1a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.821588] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6074c515-87b7-4014-985b-fcd5ba2d4ce3 [ 928.821825] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.821967] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.822044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.822244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.822334] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.822446] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6074c515-87b7-4014-985b-fcd5ba2d4ce3 already deleted. [ 928.822570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6074c515-87b7-4014-985b-fcd5ba2d4ce3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.256424] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 510642af-18db-48db-b1f9-aaba1f259c1a [ 929.256709] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.256773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.256846] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.258305] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.258931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.258931] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:510642af-18db-48db-b1f9-aaba1f259c1a already deleted. [ 929.258931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-510642af-18db-48db-b1f9-aaba1f259c1a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.721159] env[71140]: INFO networking_nsxv3.common.synchronization [req-dc3f5ad8-7687-4776-8ea2-68c0684e533b req-4299e695-739b-4a9f-a0ef-07ce3be87358 tempest-ImagesTestJSON-1376189349 tempest-ImagesTestJSON-1376189349-project-member] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 929.721419] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 929.721765] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.721859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.721905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.722126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.722278] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.722377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.722440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.722591] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.722678] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.722769] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.142848] env[71140]: INFO networking_nsxv3.common.synchronization [req-553f670b-bc98-46ba-bfb7-85d2cc2e0783 req-75682108-6911-4c5f-bb0e-646351bd2d69 tempest-ServersAdminTestJSON-2080308680 tempest-ServersAdminTestJSON-2080308680-project-member] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 930.143399] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGHEST for action security_group_members [ 930.143697] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.143817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.143884] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.144092] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.144244] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.144339] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.144401] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.144546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.144628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.144719] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.224835] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.471904] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42db4b7-b71b-4297-acb7-b4910e7af664 in Status: SUCCESS [ 930.472237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.472658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.473378] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.473378] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.473378] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.473378] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.473671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.473671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.474168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.474347] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e42db4b7-b71b-4297-acb7-b4910e7af664',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.516158] env[71140]: INFO networking_nsxv3.common.synchronization [None req-9793d81f-b7e8-4016-9a3f-a16d779b8b99 None None] Enqueued Resource ID: 6ff542e8-8096-4755-a486-b4ae60c1274a with Priority: HIGHEST for action port [ 930.516698] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ff542e8-8096-4755-a486-b4ae60c1274a with Priority: HIGHEST for action port [ 930.517019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ff542e8-8096-4755-a486-b4ae60c1274a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.517183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ff542e8-8096-4755-a486-b4ae60c1274a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.517239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ff542e8-8096-4755-a486-b4ae60c1274a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.519152] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ff542e8-8096-4755-a486-b4ae60c1274a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.519637] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ff542e8-8096-4755-a486-b4ae60c1274a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.647841] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.648268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.648268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.648386] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.648477] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.648682] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.648803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.649068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.649068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.649158] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.649195] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be updated. [ 930.657212] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-920 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.657405] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.657534] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.657785] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.658054] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.658214] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.658333] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.660131] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.660131] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.660131] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.660131] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.661171] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.661171] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.661171] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.662079] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.662308] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.682825] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.683013] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 930.683162] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.683343] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.683668] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-b1c30f03-87bb-4329-85ca-6d53c2771448 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.683845] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-b1c30f03-87bb-4329-85ca-6d53c2771448" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.683966] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-b1c30f03-87bb-4329-85ca-6d53c2771448" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.684326] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-b1c30f03-87bb-4329-85ca-6d53c2771448" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.684763] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1c30f03-87bb-4329-85ca-6d53c2771448',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.687359] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.687359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.687359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.687359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.687359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.697110] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: IN_PROGRESS for 2s [ 930.727606] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.758948] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d in Status: SUCCESS [ 930.759642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.976736] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e42db4b7-b71b-4297-acb7-b4910e7af664',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.022810] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ff542e8-8096-4755-a486-b4ae60c1274a [ 931.023084] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.023223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.023292] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.023503] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.023592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.023688] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ff542e8-8096-4755-a486-b4ae60c1274a already deleted. [ 931.023773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ff542e8-8096-4755-a486-b4ae60c1274a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.189628] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.189748] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.189806] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.190147] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.190230] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.190374] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port b1c30f03-87bb-4329-85ca-6d53c2771448 not found, creating... [ 931.190641] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.190797] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.190914] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.191183] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.191295] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.192757] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.192757] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.192757] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.193062] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.193062] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.193193] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: b1c30f03-87bb-4329-85ca-6d53c2771448 is going to be created. [ 931.213627] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.214412] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.214577] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.214847] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.216096] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.216096] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-b1c30f03-87bb-4329-85ca-6d53c2771448" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.231563] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.231563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.231563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.231563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.231563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.231563] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be updated. [ 931.276968] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.277231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.277231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.278043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.278043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.292503] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 931.479470] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e42db4b7-b71b-4297-acb7-b4910e7af664: rpc.has_security_group_logging(os_id): False [ 931.498250] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.498626] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.498780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.499097] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.499279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.499615] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.499812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.500015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.500359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.500620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.500821] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42db4b7-b71b-4297-acb7-b4910e7af664 is going to be created. [ 931.570994] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.571288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.571402] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.571727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.571994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.586648] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42db4b7-b71b-4297-acb7-b4910e7af664 in Status: IN_PROGRESS for 2s [ 932.528018] env[71140]: INFO networking_nsxv3.common.synchronization [req-b6d09328-e545-43ea-a58f-40bfdd649a9e req-0e573d81-14fe-44d5-ba42-4d5590720029 tempest-DeleteServersTestJSON-1199867382 tempest-DeleteServersTestJSON-1199867382-project-member] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 932.529549] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 932.530241] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.530403] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.530537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.530823] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.532281] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.532281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.532412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.532582] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.532771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.533217] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.613703] env[71140]: INFO networking_nsxv3.common.synchronization [req-dc3f5ad8-7687-4776-8ea2-68c0684e533b req-3c972a08-9ca2-4663-ab07-235e50ca9729 service nova] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_rules [ 932.614463] env[71140]: INFO networking_nsxv3.common.synchronization [req-dc3f5ad8-7687-4776-8ea2-68c0684e533b req-3c972a08-9ca2-4663-ab07-235e50ca9729 service nova] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 932.614463] env[71140]: INFO networking_nsxv3.common.synchronization [req-dc3f5ad8-7687-4776-8ea2-68c0684e533b req-3c972a08-9ca2-4663-ab07-235e50ca9729 service nova] Enqueued Resource ID: b1c30f03-87bb-4329-85ca-6d53c2771448 with Priority: HIGHEST for action port [ 932.614692] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_rules [ 932.615354] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 932.615354] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c30f03-87bb-4329-85ca-6d53c2771448 with Priority: HIGHEST for action port [ 932.617307] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.617911] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.617911] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.617911] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.617911] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.619176] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.619796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.620088] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1c30f03-87bb-4329-85ca-6d53c2771448 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.620255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1c30f03-87bb-4329-85ca-6d53c2771448" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.620379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1c30f03-87bb-4329-85ca-6d53c2771448" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.620622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1c30f03-87bb-4329-85ca-6d53c2771448" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.621150] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1c30f03-87bb-4329-85ca-6d53c2771448',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.706893] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 184bb91c-9526-466a-820b-ced20908d98e in Status: SUCCESS [ 932.706976] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 184bb91c-9526-466a-820b-ced20908d98e deletion is rescheduled due to dependency. [ 932.707335] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.038660] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.038952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.038952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.041126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.041126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.041126] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.041126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.041126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.041126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.041126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.041126] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be deleted. [ 933.070064] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.070323] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.070323] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.070530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.073067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.073067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.124465] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.124465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.124593] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1c30f03-87bb-4329-85ca-6d53c2771448 with status ACTIVE [ 933.124893] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.124893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.125081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.129039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.129039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.129039] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.129039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.129039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.129039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.129039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.129039] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.129039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.129039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.129039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.129039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.129039] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1c30f03-87bb-4329-85ca-6d53c2771448 is going to be updated. [ 933.165770] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.165922] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.166016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.166256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.166397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.166558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1c30f03-87bb-4329-85ca-6d53c2771448" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.231844] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-351 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.232069] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.232303] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.232515] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.232781] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.232957] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.233088] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.233337] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.233610] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.233707] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.233840] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 933.233990] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 933.234087] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 933.234204] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.234326] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 933.234540] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 933.260106] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 933.260370] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 933.260652] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 933.260761] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.261140] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-b8729210-5805-4824-a2d4-deacd6e52153 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.261366] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-b8729210-5805-4824-a2d4-deacd6e52153" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.261578] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-b8729210-5805-4824-a2d4-deacd6e52153" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.262041] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-b8729210-5805-4824-a2d4-deacd6e52153" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.263070] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8729210-5805-4824-a2d4-deacd6e52153',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.305913] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 933.306294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.306800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.307092] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.307319] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.307467] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.307555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.307771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.307858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.307984] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.599748] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42db4b7-b71b-4297-acb7-b4910e7af664 in Status: SUCCESS [ 933.600127] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.767426] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.767661] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.767804] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.768173] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.768332] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.768506] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port b8729210-5805-4824-a2d4-deacd6e52153 not found, creating... [ 933.769976] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.770265] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.770393] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.771647] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.771838] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.772199] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.772387] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.772516] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.772793] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.772990] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.773511] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: b8729210-5805-4824-a2d4-deacd6e52153 is going to be created. [ 933.794572] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.794727] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.794780] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.795506] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.795506] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.795641] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-b8729210-5805-4824-a2d4-deacd6e52153" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.812900] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.317819] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.681214] env[71140]: INFO networking_nsxv3.common.synchronization [req-b6d09328-e545-43ea-a58f-40bfdd649a9e req-4c9d2428-97c5-44b2-8ada-8bc9798ebac0 service nova] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_rules [ 934.681214] env[71140]: INFO networking_nsxv3.common.synchronization [req-b6d09328-e545-43ea-a58f-40bfdd649a9e req-4c9d2428-97c5-44b2-8ada-8bc9798ebac0 service nova] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 934.681693] env[71140]: INFO networking_nsxv3.common.synchronization [req-b6d09328-e545-43ea-a58f-40bfdd649a9e req-4c9d2428-97c5-44b2-8ada-8bc9798ebac0 service nova] Enqueued Resource ID: b8729210-5805-4824-a2d4-deacd6e52153 with Priority: HIGHEST for action port [ 934.682630] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_rules [ 934.682882] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 934.683068] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8729210-5805-4824-a2d4-deacd6e52153 with Priority: HIGHEST for action port [ 934.683570] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.683878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.684012] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.684328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.684488] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.685841] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.686698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.686858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.691023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.691023] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.691023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.691023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.691023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.691023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.691023] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.691023] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8729210-5805-4824-a2d4-deacd6e52153 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.691023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8729210-5805-4824-a2d4-deacd6e52153" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.691023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8729210-5805-4824-a2d4-deacd6e52153" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.691023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8729210-5805-4824-a2d4-deacd6e52153" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.691023] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8729210-5805-4824-a2d4-deacd6e52153',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.822431] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.822431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.822431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.822431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.822431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.822431] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be updated. [ 934.912080] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.913235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.913235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.913235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.913235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.921628] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 934.981187] env[71140]: INFO networking_nsxv3.common.synchronization [req-d7caaad3-4bf7-4d19-9307-d5c2b51f2485 req-55647c13-a3c9-495e-aae8-0edc72b9fbb1 tempest-DeleteServersAdminTestJSON-1158134219 tempest-DeleteServersAdminTestJSON-1158134219-project-member] Enqueued Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGHEST for action security_group_members [ 934.981187] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGHEST for action security_group_members [ 934.981187] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.981403] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.981403] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.981607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.981758] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.981830] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.981894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.984563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.984709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.984822] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.195545] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.195545] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.195545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.200465] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8729210-5805-4824-a2d4-deacd6e52153 with status ACTIVE [ 935.200465] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.200465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.200465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.200465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.200465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.200465] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.200465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.200465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.200465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.200465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.200465] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.200465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.200465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.200465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.201015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.201015] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8729210-5805-4824-a2d4-deacd6e52153 is going to be updated. [ 935.221774] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.221991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.222145] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.222408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.222759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.223151] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8729210-5805-4824-a2d4-deacd6e52153" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.306393] env[71140]: INFO networking_nsxv3.common.synchronization [req-36f3f963-825c-4982-8734-d516f778fc78 req-17f46c6e-0bcf-4406-968a-3f083d8033b9 tempest-MigrationsAdminTest-2143534678 tempest-MigrationsAdminTest-2143534678-project-member] Enqueued Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGHEST for action security_group_members [ 935.307764] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGHEST for action security_group_members [ 935.308301] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.308534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.308613] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.308928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.309201] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.309379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.309465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.309712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.309857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.310014] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.488875] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.489069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.489146] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.489382] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.489502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.489696] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.489790] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.489898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.490044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.490105] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.490226] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 already deleted. [ 935.490279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.614257] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.614494] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.614600] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.617114] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.617114] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.617114] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.617114] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.617114] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.617114] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.617114] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 935.617807] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.617807] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.617807] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.617807] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 935.617807] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.617807] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.637617] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.637818] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 935.637955] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.638204] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.638542] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-3f45f71d-6b73-4dfa-bd9f-9aad6da8433f taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.638729] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-3f45f71d-6b73-4dfa-bd9f-9aad6da8433f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.638875] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-3f45f71d-6b73-4dfa-bd9f-9aad6da8433f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.639469] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-3f45f71d-6b73-4dfa-bd9f-9aad6da8433f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.639469] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f45f71d-6b73-4dfa-bd9f-9aad6da8433f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.695841] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.814249] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.814475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.814475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.817135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.817135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.817135] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.817135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.817135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.817135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.817135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.817135] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0021f162-837d-4356-afbf-4e10e33828d6 is going to be updated. [ 935.843058] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.843285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.843362] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.843600] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.844113] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.854551] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0021f162-837d-4356-afbf-4e10e33828d6 in Status: IN_PROGRESS for 2s [ 936.147819] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.147819] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.147819] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.147819] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.148086] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.148086] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 3f45f71d-6b73-4dfa-bd9f-9aad6da8433f not found, creating... [ 936.148377] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.149030] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.149030] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.149030] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.149271] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.152967] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.153163] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.153293] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.153584] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.153823] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.153823] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 3f45f71d-6b73-4dfa-bd9f-9aad6da8433f is going to be created. [ 936.172196] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.172430] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.172567] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.172840] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.173729] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.173729] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-3f45f71d-6b73-4dfa-bd9f-9aad6da8433f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.201069] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.201596] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.201596] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.201596] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.201781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.201781] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be created. [ 936.243261] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.243454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.243499] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.243921] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.243921] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.263278] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: UNINITIALIZED for 2s [ 936.783949] env[71140]: INFO networking_nsxv3.common.synchronization [req-4688d458-4ade-43ee-83e9-5f445fa6d36e req-f27d31f1-9819-486f-a5c6-74b048ea73ca tempest-ServerActionsTestOtherB-2025667431 tempest-ServerActionsTestOtherB-2025667431-project-member] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 936.784786] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 936.785235] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.785400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.785491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.785727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.786237] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.786349] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.786414] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.787269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.787269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.787269] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.932155] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 936.932155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.932155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.932155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.932155] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.932622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.932622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.932622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.932622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.932801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.932851] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.039074] env[71140]: INFO networking_nsxv3.common.synchronization [req-d7caaad3-4bf7-4d19-9307-d5c2b51f2485 req-7dd23349-4ccc-4364-87d0-51e7ae9999be service nova] Enqueued Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGHEST for action security_group_rules [ 937.039273] env[71140]: INFO networking_nsxv3.common.synchronization [req-d7caaad3-4bf7-4d19-9307-d5c2b51f2485 req-7dd23349-4ccc-4364-87d0-51e7ae9999be service nova] Enqueued Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGHEST for action security_group_members [ 937.039421] env[71140]: INFO networking_nsxv3.common.synchronization [req-d7caaad3-4bf7-4d19-9307-d5c2b51f2485 req-7dd23349-4ccc-4364-87d0-51e7ae9999be service nova] Enqueued Resource ID: 3f45f71d-6b73-4dfa-bd9f-9aad6da8433f with Priority: HIGHEST for action port [ 937.039979] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGHEST for action security_group_rules [ 937.040212] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGHEST for action security_group_members [ 937.040317] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f45f71d-6b73-4dfa-bd9f-9aad6da8433f with Priority: HIGHEST for action port [ 937.040604] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a18e682e-ac56-4e1b-bb5d-a95392ee84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.040725] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.040799] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.041070] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.041156] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.043512] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.043640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.043720] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.043893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.044061] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.044168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.044235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.044365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.044448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.044543] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.045416] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f45f71d-6b73-4dfa-bd9f-9aad6da8433f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.045621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f45f71d-6b73-4dfa-bd9f-9aad6da8433f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.045621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f45f71d-6b73-4dfa-bd9f-9aad6da8433f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.046556] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f45f71d-6b73-4dfa-bd9f-9aad6da8433f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.046556] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f45f71d-6b73-4dfa-bd9f-9aad6da8433f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.291399] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.291630] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.291630] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.293803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.293803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.293803] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.293803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.293803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.293803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.293803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.293803] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c is going to be updated. [ 937.321377] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.321640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.321640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.321824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.321972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.334323] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: IN_PROGRESS for 2s [ 937.435898] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.436077] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.436268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.436634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.436930] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.437218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.437218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.437886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.437886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.437886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.438087] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.438199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.438263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.438420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.438571] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.438665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.438764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.438860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.438939] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.439093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.439221] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.547208] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.547355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.547649] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.549488] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f45f71d-6b73-4dfa-bd9f-9aad6da8433f with status ACTIVE [ 937.550571] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.550571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.550571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.553124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.553124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.553124] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.553124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.553124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.553124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.553124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.553124] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.553124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.553124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.553124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.553124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.553124] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f45f71d-6b73-4dfa-bd9f-9aad6da8433f is going to be updated. [ 937.570134] env[71140]: INFO networking_nsxv3.common.synchronization [req-c86be866-8db7-4c82-903c-70cbc503efff req-4b978f09-2453-41fd-af88-c9ad4833ae61 tempest-ImagesOneServerNegativeTestJSON-512607698 tempest-ImagesOneServerNegativeTestJSON-512607698-project-member] Enqueued Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 937.570134] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 937.570729] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.571096] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.571280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.571639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.571906] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.572153] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.572379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.572681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.573922] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.573922] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.574549] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.574668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.574778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.574944] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.575288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.575350] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f45f71d-6b73-4dfa-bd9f-9aad6da8433f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.590896] env[71140]: INFO networking_nsxv3.common.synchronization [req-0bacacda-7559-4a84-92f9-42e23a03b8fb req-7dd6b01f-a34b-40b3-b24b-5b6237c8d0c0 tempest-ServersWithSpecificFlavorTestJSON-1339181312 tempest-ServersWithSpecificFlavorTestJSON-1339181312-project-member] Enqueued Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_members [ 937.591453] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62a92b8-4863-4e9d-809d-e8687b429f2a with Priority: HIGHEST for action security_group_members [ 937.592068] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-c62a92b8-4863-4e9d-809d-e8687b429f2a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.592068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.592068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.592305] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.592456] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.592614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.592681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.592961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.592961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.593140] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c62a92b8-4863-4e9d-809d-e8687b429f2a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.863831] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0021f162-837d-4356-afbf-4e10e33828d6 in Status: SUCCESS [ 937.864188] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0021f162-837d-4356-afbf-4e10e33828d6 deletion is rescheduled due to dependency. [ 937.864188] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.940982] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43a772d0-e00d-4627-ad2d-c6c3ccbcee06: rpc.has_security_group_logging(os_id): False [ 937.960196] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.960415] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.960493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.960714] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.960808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.961032] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.961127] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.961193] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.961374] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.961455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.961646] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.961741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.961803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.961944] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.962032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.962230] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.962324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.962387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.962527] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.962602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.962687] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be updated. [ 937.995154] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.995372] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-173" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.995502] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-173" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.995875] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-173" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.996055] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.996238] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.996358] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.996570] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.996718] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.996930] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 937.997889] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.997889] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.997889] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.998321] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 937.998529] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.998774] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.017846] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.018063] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 938.018203] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.018383] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-173" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.018689] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-f2c30403-9d21-4934-8e41-37446af44da5 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.018858] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-f2c30403-9d21-4934-8e41-37446af44da5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.018981] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-f2c30403-9d21-4934-8e41-37446af44da5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.019314] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-f2c30403-9d21-4934-8e41-37446af44da5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.019453] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2c30403-9d21-4934-8e41-37446af44da5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.032091] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.032237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.032287] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.032475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.032613] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.046917] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 938.050312] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.077205] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.077369] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.077435] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.077633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.077718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.077963] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.078101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.078182] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.078348] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.078425] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.078511] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 is going to be updated. [ 938.095821] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.095978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.096034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.096235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.096326] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.096513] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.096607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.096670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.096811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.096885] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.096973] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c62a92b8-4863-4e9d-809d-e8687b429f2a is going to be updated. [ 938.126460] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.126654] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.126709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.126892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.127059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.144368] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: IN_PROGRESS for 2s [ 938.161148] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.161395] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.161395] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.161659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.161772] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.170305] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62a92b8-4863-4e9d-809d-e8687b429f2a in Status: IN_PROGRESS for 2s [ 938.238456] env[71140]: INFO networking_nsxv3.common.synchronization [req-ab4ff2ee-d1f2-460a-9ed5-c3a59a4f4378 req-944fe014-c757-44fb-b82d-7c329aee8eb0 tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 938.238995] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 938.239313] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.239458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.239527] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.239783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.243260] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.243451] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.243710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.243710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.243801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.243900] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.273289] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 938.273496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.273653] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.273865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.274064] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.274179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.274242] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.274394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.274470] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.274552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.274641] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.522412] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.522412] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.522412] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.522412] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.522808] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.522808] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port f2c30403-9d21-4934-8e41-37446af44da5 not found, creating... [ 938.523119] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.523313] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.523435] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.523695] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.523877] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.527556] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.527809] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.527921] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.529755] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.529755] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.529755] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: f2c30403-9d21-4934-8e41-37446af44da5 is going to be created. [ 938.548075] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.548318] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.548503] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.548843] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.549057] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.549511] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-f2c30403-9d21-4934-8e41-37446af44da5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.554106] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.554106] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.554106] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.554106] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.554106] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.554106] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 is going to be created. [ 938.576345] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.576491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.576713] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.576808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.577119] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.581782] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-941 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.581972] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.582333] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.582715] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.583434] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.583539] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.583762] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.584096] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.584301] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.584631] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.584833] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.585012] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.585241] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.585434] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.585638] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.585869] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.588803] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 in Status: UNINITIALIZED for 2s [ 938.609404] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.611036] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 938.611036] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.611036] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.611036] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-8d07c02d-f4c0-48bb-9dff-cc98afd027ac taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.611338] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-8d07c02d-f4c0-48bb-9dff-cc98afd027ac" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.611338] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-8d07c02d-f4c0-48bb-9dff-cc98afd027ac" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.611767] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-8d07c02d-f4c0-48bb-9dff-cc98afd027ac" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.611767] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d07c02d-f4c0-48bb-9dff-cc98afd027ac',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.751517] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.752616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.752616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.752616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.752616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.752616] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.752616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.753148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.753148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.753249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.753367] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 already deleted. [ 938.753506] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.776757] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.777080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.777221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.777621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.777960] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.778960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.778960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.778960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.778960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.778960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.779277] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.779434] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.779526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.779753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.779989] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.780232] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.780342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.780607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.780770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.780958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.781313] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.117023] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.117023] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.117023] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.117023] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.117023] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.117023] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 8d07c02d-f4c0-48bb-9dff-cc98afd027ac not found, creating... [ 939.117023] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.117023] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.117023] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.117689] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.117689] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.117689] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.117928] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.118127] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.118362] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.118536] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.118745] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 8d07c02d-f4c0-48bb-9dff-cc98afd027ac is going to be created. [ 939.141470] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.141693] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.141820] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.142136] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.142367] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.142601] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-8d07c02d-f4c0-48bb-9dff-cc98afd027ac" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.287156] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c549bd3-468a-4655-b709-3480ff374e11: rpc.has_security_group_logging(os_id): False [ 939.306923] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.308633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.308633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.308633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.308633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.308633] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.308633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.308633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.308633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.308633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.309016] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.309016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.309016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.313019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.313019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.313019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.313019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.313019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.313019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.313019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.313019] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be created. [ 939.343708] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: SUCCESS [ 939.343904] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c deletion is rescheduled due to dependency. [ 939.344038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.405704] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.406074] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.406260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.406784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.407130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.420977] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 939.484339] env[71140]: INFO networking_nsxv3.common.synchronization [req-c86be866-8db7-4c82-903c-70cbc503efff req-118e2bb2-d85f-4293-9318-5b446fbbcae4 service nova] Enqueued Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_rules [ 939.484339] env[71140]: INFO networking_nsxv3.common.synchronization [req-c86be866-8db7-4c82-903c-70cbc503efff req-118e2bb2-d85f-4293-9318-5b446fbbcae4 service nova] Enqueued Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 939.484339] env[71140]: INFO networking_nsxv3.common.synchronization [req-c86be866-8db7-4c82-903c-70cbc503efff req-118e2bb2-d85f-4293-9318-5b446fbbcae4 service nova] Enqueued Resource ID: f2c30403-9d21-4934-8e41-37446af44da5 with Priority: HIGHEST for action port [ 939.484339] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_rules [ 939.484339] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 939.484339] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2c30403-9d21-4934-8e41-37446af44da5 with Priority: HIGHEST for action port [ 939.485038] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.485324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.488040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.488040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.488040] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.488040] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.488040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.488040] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2c30403-9d21-4934-8e41-37446af44da5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.488040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2c30403-9d21-4934-8e41-37446af44da5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.488040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2c30403-9d21-4934-8e41-37446af44da5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.488040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2c30403-9d21-4934-8e41-37446af44da5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.488040] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2c30403-9d21-4934-8e41-37446af44da5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.834168] env[71140]: INFO networking_nsxv3.common.synchronization [req-ab4ff2ee-d1f2-460a-9ed5-c3a59a4f4378 req-03035d7d-1c49-45ca-837f-28eda51b63e5 service nova] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_rules [ 939.834168] env[71140]: INFO networking_nsxv3.common.synchronization [req-ab4ff2ee-d1f2-460a-9ed5-c3a59a4f4378 req-03035d7d-1c49-45ca-837f-28eda51b63e5 service nova] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 939.834168] env[71140]: INFO networking_nsxv3.common.synchronization [req-ab4ff2ee-d1f2-460a-9ed5-c3a59a4f4378 req-03035d7d-1c49-45ca-837f-28eda51b63e5 service nova] Enqueued Resource ID: 8d07c02d-f4c0-48bb-9dff-cc98afd027ac with Priority: HIGHEST for action port [ 939.834669] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_rules [ 939.835078] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 939.835224] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d07c02d-f4c0-48bb-9dff-cc98afd027ac with Priority: HIGHEST for action port [ 939.835516] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.835644] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.835713] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.835973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.836070] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.837380] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.837503] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.837573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.837758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.837955] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.838012] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.838060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.838208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.838452] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.838551] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.840133] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d07c02d-f4c0-48bb-9dff-cc98afd027ac taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.840249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d07c02d-f4c0-48bb-9dff-cc98afd027ac" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.840318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d07c02d-f4c0-48bb-9dff-cc98afd027ac" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.840478] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d07c02d-f4c0-48bb-9dff-cc98afd027ac" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.840554] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d07c02d-f4c0-48bb-9dff-cc98afd027ac',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.990925] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2c30403-9d21-4934-8e41-37446af44da5 with status ACTIVE [ 939.991216] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.991366] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.991440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.991736] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.991887] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.992115] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.992226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.992290] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.992465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.992548] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.992732] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.992831] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.992894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.993042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.993123] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.993209] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2c30403-9d21-4934-8e41-37446af44da5 is going to be updated. [ 939.994623] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.994734] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.014171] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.014363] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.014438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.014665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.014831] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.015047] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2c30403-9d21-4934-8e41-37446af44da5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.062992] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 940.063737] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.154867] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: SUCCESS [ 940.155210] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 deletion is rescheduled due to dependency. [ 940.155210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.155320] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.155548] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.155779] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.155923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.155991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.156168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.156255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.156356] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.187272] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c62a92b8-4863-4e9d-809d-e8687b429f2a in Status: SUCCESS [ 940.187422] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c62a92b8-4863-4e9d-809d-e8687b429f2a deletion is rescheduled due to dependency. [ 940.187550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c62a92b8-4863-4e9d-809d-e8687b429f2a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.341344] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.342416] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.342531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.344080] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d07c02d-f4c0-48bb-9dff-cc98afd027ac with status ACTIVE [ 940.344327] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.344497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.344571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.344788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.344880] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.345116] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.345270] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.345343] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.345520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.345603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.345795] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.345890] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.345952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.346160] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.346292] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.346401] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d07c02d-f4c0-48bb-9dff-cc98afd027ac is going to be updated. [ 940.364887] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.365081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.365135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.365330] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.365470] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.365637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d07c02d-f4c0-48bb-9dff-cc98afd027ac" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.599357] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 in Status: SUCCESS [ 940.599634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.599807] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.600122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.600330] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.600468] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.600536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.600708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.600789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.600870] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.600963] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.658838] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.843765] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.953533] env[71140]: INFO networking_nsxv3.common.synchronization [req-52855e72-f674-4bf7-af55-51b4802abfcb req-acdaf8e6-e488-4df8-adf3-149e774766b9 tempest-ServerActionsTestJSON-2079743708 tempest-ServerActionsTestJSON-2079743708-project-member] Enqueued Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 940.954159] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 940.954507] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.954729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.958237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.958438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.958650] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.958792] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.958861] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.959144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.960119] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.960119] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.103863] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.104072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.104113] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.104301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.105025] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.105025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.105025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.105025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.105025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.105025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.105328] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.105328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.105328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.106341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.106495] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.106593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.106657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.106841] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.107476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.107611] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.107717] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.160900] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.346633] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.346805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.346879] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.347166] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.347267] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.347372] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be created. [ 941.368844] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.369017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.369058] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.369373] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.369538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.378332] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: UNINITIALIZED for 2s [ 941.393868] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-168 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.394115] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-168" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.394304] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-168" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.394683] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-168" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.394939] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.395273] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.395273] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.395456] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.395605] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.395893] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.396017] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.396134] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.396247] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.396359] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.396523] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.396591] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.415722] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.415921] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 941.415921] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.416085] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-168" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.416421] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-101e71e3-b306-452a-b7de-a4fdae190a1a taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.416682] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-101e71e3-b306-452a-b7de-a4fdae190a1a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.417287] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-101e71e3-b306-452a-b7de-a4fdae190a1a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.417576] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-101e71e3-b306-452a-b7de-a4fdae190a1a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.417576] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('101e71e3-b306-452a-b7de-a4fdae190a1a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.434972] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 941.435293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.461762] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.462236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.462450] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.462973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.463216] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.463407] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.463553] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.463627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.463820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.463905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.464044] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 already deleted. [ 941.464138] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.612896] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a18e682e-ac56-4e1b-bb5d-a95392ee84c6: rpc.has_security_group_logging(os_id): False [ 941.639173] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.639173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.639173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.639173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.639173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.639173] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.639173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.639173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.639173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.639173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.639173] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.639173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.639173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.639973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.640239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.640590] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.643101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.643101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.643101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.643101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.643101] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 is going to be created. [ 941.666043] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.666043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.666043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.666043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.666043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.666043] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 is going to be updated. [ 941.693707] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.693707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.693707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.694996] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.694996] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.700967] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.700967] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.700967] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.700967] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.701231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.706704] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: IN_PROGRESS for 2s [ 941.712040] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 in Status: IN_PROGRESS for 2s [ 941.921927] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.922450] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.922679] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.923359] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.923359] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.924031] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 101e71e3-b306-452a-b7de-a4fdae190a1a not found, creating... [ 941.924031] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.924332] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.924757] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.924936] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.925172] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.925890] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.926183] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.926183] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.926485] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.926687] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.926887] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 101e71e3-b306-452a-b7de-a4fdae190a1a is going to be created. [ 941.946011] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.946446] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.946446] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.946774] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.947060] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.947374] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-101e71e3-b306-452a-b7de-a4fdae190a1a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.835211] env[71140]: INFO networking_nsxv3.common.synchronization [req-52855e72-f674-4bf7-af55-51b4802abfcb req-81cca2cd-967b-422e-9029-decc871ca610 service nova] Enqueued Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_rules [ 942.835477] env[71140]: INFO networking_nsxv3.common.synchronization [req-52855e72-f674-4bf7-af55-51b4802abfcb req-81cca2cd-967b-422e-9029-decc871ca610 service nova] Enqueued Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 942.835599] env[71140]: INFO networking_nsxv3.common.synchronization [req-52855e72-f674-4bf7-af55-51b4802abfcb req-81cca2cd-967b-422e-9029-decc871ca610 service nova] Enqueued Resource ID: 101e71e3-b306-452a-b7de-a4fdae190a1a with Priority: HIGHEST for action port [ 942.836128] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_rules [ 942.836256] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 942.836381] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 101e71e3-b306-452a-b7de-a4fdae190a1a with Priority: HIGHEST for action port [ 942.836673] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.836796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.836865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.837221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.837259] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.838822] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.839023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.839123] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.839411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.839606] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.839685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.839744] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.839909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.839994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.840838] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.843560] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-101e71e3-b306-452a-b7de-a4fdae190a1a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.843855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-101e71e3-b306-452a-b7de-a4fdae190a1a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.843855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-101e71e3-b306-452a-b7de-a4fdae190a1a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.843986] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-101e71e3-b306-452a-b7de-a4fdae190a1a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.844037] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('101e71e3-b306-452a-b7de-a4fdae190a1a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.344283] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.345740] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.345866] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.349731] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 101e71e3-b306-452a-b7de-a4fdae190a1a with status ACTIVE [ 943.349772] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.349898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.349965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.350210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.350296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.350489] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.350646] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.350716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.350866] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.350942] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.351156] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.351246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.351303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.351440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.351512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.351840] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 101e71e3-b306-452a-b7de-a4fdae190a1a is going to be updated. [ 943.373053] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.373253] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.373298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.373484] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.373623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.373789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-101e71e3-b306-452a-b7de-a4fdae190a1a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.387544] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 943.387800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.388009] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.388271] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.388530] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.388659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.388732] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.388933] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.389057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.389196] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.389293] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.717390] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: SUCCESS [ 943.717611] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.717776] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.718010] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.718218] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.718432] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.718432] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.718626] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.718714] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.718803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.718897] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.720622] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 in Status: SUCCESS [ 943.720835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.846277] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.891989] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.892191] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.892278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.892522] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.892769] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.892879] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.893059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.893176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.893307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.893468] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.893656] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.893760] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.893854] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.894048] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.894195] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.894291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.894352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.894497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.894575] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.894657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.894746] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.222480] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.222641] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.222718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.222980] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.223175] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.223275] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.223336] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.223508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.223618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.223693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.223880] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.223941] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.224017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.224166] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.224312] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.224406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.224548] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.224606] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.224707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.224764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.224893] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.349231] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.349429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.349468] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.349673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.349764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.349862] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 is going to be created. [ 944.372582] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.372828] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.372951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.373155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.373328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.383489] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: UNINITIALIZED for 2s [ 944.399180] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7d76214-330f-43f9-a3bd-c36a084b6ab5: rpc.has_security_group_logging(os_id): False [ 944.416769] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.416937] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.417066] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.417421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.417539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.417802] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.417930] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.417987] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.418189] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.418486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.418704] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.418804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.418862] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.419046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.419155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.419778] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.419778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.419778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.419778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.419778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.420116] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be created. [ 944.478644] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.479113] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.479113] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.479287] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.479569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.490108] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: IN_PROGRESS for 2s [ 944.727986] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1100ce56-f855-47e4-96bb-f4bbe37e7632: rpc.has_security_group_logging(os_id): False [ 944.745334] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.745544] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.745668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.745927] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.746039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.746616] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.746616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.746616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.746855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.746855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.747045] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.747226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.747713] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.747713] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.747713] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.747872] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.747933] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.747982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.748176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.748275] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.748366] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 is going to be updated. [ 944.808173] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.808417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.808503] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.808857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.808857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.823795] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: IN_PROGRESS for 2s [ 945.684422] env[71140]: INFO networking_nsxv3.common.synchronization [None req-2988ef76-3b33-4a79-829e-3d0045d2729b tempest-ServerDiskConfigTestJSON-63292790 tempest-ServerDiskConfigTestJSON-63292790-project-member] Enqueued Resource ID: 2176a6dd-07c8-4bb6-be2c-db9dd5899c81 with Priority: HIGHEST for action security_group_rules [ 945.685672] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2176a6dd-07c8-4bb6-be2c-db9dd5899c81 with Priority: HIGHEST for action security_group_rules [ 945.685672] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2176a6dd-07c8-4bb6-be2c-db9dd5899c81 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.685929] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2176a6dd-07c8-4bb6-be2c-db9dd5899c81" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.685929] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2176a6dd-07c8-4bb6-be2c-db9dd5899c81" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.686594] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2176a6dd-07c8-4bb6-be2c-db9dd5899c81" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.686594] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2176a6dd-07c8-4bb6-be2c-db9dd5899c81',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.761280] env[71140]: INFO networking_nsxv3.common.synchronization [None req-996dc60d-ba6d-4a66-949a-11c1b191bce7 tempest-ServerDiskConfigTestJSON-63292790 tempest-ServerDiskConfigTestJSON-63292790-project-member] Enqueued Resource ID: 2176a6dd-07c8-4bb6-be2c-db9dd5899c81 with Priority: HIGHEST for action security_group_rules [ 945.761770] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2176a6dd-07c8-4bb6-be2c-db9dd5899c81 with Priority: HIGHEST for action security_group_rules [ 945.762101] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2176a6dd-07c8-4bb6-be2c-db9dd5899c81 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.762213] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2176a6dd-07c8-4bb6-be2c-db9dd5899c81" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.221704] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.222856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.223067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.223395] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.223608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.223825] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2176a6dd-07c8-4bb6-be2c-db9dd5899c81 already deleted. [ 946.223998] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2176a6dd-07c8-4bb6-be2c-db9dd5899c81" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.224296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2176a6dd-07c8-4bb6-be2c-db9dd5899c81" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.224551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2176a6dd-07c8-4bb6-be2c-db9dd5899c81" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.224713] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2176a6dd-07c8-4bb6-be2c-db9dd5899c81',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.393104] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: SUCCESS [ 946.393347] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.393514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.393740] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.393940] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.394067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.394125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.394274] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.394355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.394441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.394533] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.508822] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 946.508822] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.747178] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.747536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.747536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.747626] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.747928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.747928] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2176a6dd-07c8-4bb6-be2c-db9dd5899c81 already deleted. [ 946.747928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2176a6dd-07c8-4bb6-be2c-db9dd5899c81" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.840163] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: SUCCESS [ 946.840163] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.897019] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.399825] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e62d50e-c934-4166-825a-6649880de6a7: rpc.has_security_group_logging(os_id): False [ 947.419045] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.419045] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.419045] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.419543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.419543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.419831] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.419929] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.420012] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.420273] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.420381] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.420506] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 is going to be created. [ 947.472923] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.473197] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.473197] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.473370] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.473587] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.483456] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: IN_PROGRESS for 2s [ 947.987925] env[71140]: INFO networking_nsxv3.common.synchronization [req-33a54027-99bc-4223-afd8-752baaa2dcdf req-6394911d-54ad-4575-b212-70a92a1fb190 tempest-MultipleCreateTestJSON-727311014 tempest-MultipleCreateTestJSON-727311014-project-member] Enqueued Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 947.988479] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 947.988784] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.988888] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.988951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.989393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.989905] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.989905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.989905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.989905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.990102] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.990102] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.310265] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-855 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.310412] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-855" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.310547] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-855" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.310931] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-855" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.311343] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.311532] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.311661] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.312017] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.312232] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.312545] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.313275] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.313275] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.313275] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.313275] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.313275] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.313489] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.331930] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.331930] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 948.331930] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.331930] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-855" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.332162] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.332263] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.332430] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.332752] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.332909] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.494053] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.494053] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.494228] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.494490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.494490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.494782] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.494867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.494867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.495712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.495712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.495712] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 already deleted. [ 948.495712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.835229] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.835524] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.835624] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.835921] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.836093] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.836255] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3 not found, creating... [ 948.836524] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.836683] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.836805] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.837038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.837210] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.837515] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.837683] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.837805] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.838054] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.838201] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.838347] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3 is going to be created. [ 948.859038] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.859272] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.859427] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.859790] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.859932] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.860187] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.019109] env[71140]: INFO networking_nsxv3.common.synchronization [req-6918579b-4792-4d09-a99a-3a76da8c3a57 req-b42bf058-778a-4cf9-a172-baf062ab434a tempest-DeleteServersAdminTestJSON-1603719002 tempest-DeleteServersAdminTestJSON-1603719002-project-admin] Enqueued Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGHEST for action security_group_members [ 949.019495] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGHEST for action security_group_members [ 949.020018] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.020294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.020391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.020623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.020821] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.020951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.021073] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.021320] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.021442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.021606] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.281748] env[71140]: INFO networking_nsxv3.common.synchronization [req-84ea565a-fd3c-49a6-8cfb-c3c7c9a11a6a req-1f346ab1-c159-456d-86c3-989bf1d0f49a tempest-ServerDiskConfigTestJSON-63292790 tempest-ServerDiskConfigTestJSON-63292790-project-member] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 949.282486] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 949.282917] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.283261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.283382] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.283669] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.283917] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.284081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.284180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.284399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.284529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.284739] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.494573] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: SUCCESS [ 949.494880] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.525866] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.526126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.526209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.527148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.527148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.527148] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.527148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.527148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.527402] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.527432] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.527564] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 is going to be updated. [ 949.553273] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.553461] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.553555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.553817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.553972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.562411] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 in Status: IN_PROGRESS for 2s [ 949.732135] env[71140]: INFO networking_nsxv3.common.synchronization [req-33a54027-99bc-4223-afd8-752baaa2dcdf req-62376954-5a37-4806-aa0b-8a5139ba3fa2 service nova] Enqueued Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_rules [ 949.732329] env[71140]: INFO networking_nsxv3.common.synchronization [req-33a54027-99bc-4223-afd8-752baaa2dcdf req-62376954-5a37-4806-aa0b-8a5139ba3fa2 service nova] Enqueued Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 949.732473] env[71140]: INFO networking_nsxv3.common.synchronization [req-33a54027-99bc-4223-afd8-752baaa2dcdf req-62376954-5a37-4806-aa0b-8a5139ba3fa2 service nova] Enqueued Resource ID: 9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3 with Priority: HIGHEST for action port [ 949.732745] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_rules [ 949.732880] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 949.733015] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3 with Priority: HIGHEST for action port [ 949.733604] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.733761] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.733843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.735212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.735327] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.736211] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.736344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.736424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.736599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.736761] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.736856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.736915] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.737133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.737226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.737334] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.738460] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.738617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.738617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.738775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.738848] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.787547] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.787795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.787795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.787954] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.788117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.788340] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.788442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.788494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.788665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.788745] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.788832] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 949.814503] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.814688] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.814758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.814986] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.815171] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.823585] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 950.241518] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.241816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.241960] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.243900] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3 with status ACTIVE [ 950.243900] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.243900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.243900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.243900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.243900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.245835] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.249315] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.249456] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.250469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.250469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.250469] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.250469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.250469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.250469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.250752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.250752] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3 is going to be updated. [ 950.271222] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.271360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.271417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.271661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.271788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.272015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c5edb1e-bf4a-4f39-a9ff-a4f9ac3b68c3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.476113] env[71140]: INFO networking_nsxv3.common.synchronization [req-33a54027-99bc-4223-afd8-752baaa2dcdf req-71f92c78-e700-4383-9461-3972469386b4 tempest-MultipleCreateTestJSON-727311014 tempest-MultipleCreateTestJSON-727311014-project-member] Enqueued Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 950.476812] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 950.477114] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.477251] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.755028] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.859547] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-855 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.859765] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-855" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.859893] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-855" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.860185] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-855" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.860450] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.860612] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.860734] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.860954] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.861124] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.861335] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 950.862622] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 950.862622] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 950.862622] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 950.862622] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 950.862622] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 950.862622] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 950.881033] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 950.881217] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 950.881364] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 950.881537] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-855" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.881868] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-90d987bc-da15-40c1-99d7-29dca3ef3cab taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.882132] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-90d987bc-da15-40c1-99d7-29dca3ef3cab" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.882196] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-90d987bc-da15-40c1-99d7-29dca3ef3cab" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.882496] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-90d987bc-da15-40c1-99d7-29dca3ef3cab" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.882667] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90d987bc-da15-40c1-99d7-29dca3ef3cab',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.256546] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.256864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.256864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.256986] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.257168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.257304] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 is going to be created. [ 951.279522] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.281546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.281546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.281546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.281546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.289908] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: UNINITIALIZED for 2s [ 951.386318] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.386318] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.386318] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.386318] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.386318] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.386318] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 90d987bc-da15-40c1-99d7-29dca3ef3cab not found, creating... [ 951.386645] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.386850] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.386850] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.387086] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.387249] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.387542] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.387695] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.387896] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.388924] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.389921] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.389921] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 90d987bc-da15-40c1-99d7-29dca3ef3cab is going to be created. [ 951.412035] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.412470] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.412470] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.412579] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.412839] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.413080] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-90d987bc-da15-40c1-99d7-29dca3ef3cab" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.442333] env[71140]: INFO networking_nsxv3.common.synchronization [req-db71ebe4-356e-4387-b3f8-ad2dc637defe req-e4c8210a-6cb8-405b-b293-15b38cb3182e tempest-ImagesTestJSON-1376189349 tempest-ImagesTestJSON-1376189349-project-member] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 951.442865] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 951.443188] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.443309] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.443374] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.443575] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.443769] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.443834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.443872] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.444060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.444162] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.444256] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.574408] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 in Status: SUCCESS [ 951.575294] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 deletion is rescheduled due to dependency. [ 951.575294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.834873] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 951.840163] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 deletion is rescheduled due to dependency. [ 951.840163] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.946621] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.046446] env[71140]: INFO networking_nsxv3.common.synchronization [req-f8dfbf77-50bf-442e-9276-55a1e8169c5a req-47d7132b-f536-46e8-9d4e-fb22ebff2950 tempest-ImagesOneServerNegativeTestJSON-512607698 tempest-ImagesOneServerNegativeTestJSON-512607698-project-member] Enqueued Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 952.046446] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGHEST for action security_group_members [ 952.046446] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.047045] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.047338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.048262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.048262] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.048262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.048262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.048262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.048527] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.048646] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.256346] env[71140]: INFO networking_nsxv3.common.synchronization [req-33a54027-99bc-4223-afd8-752baaa2dcdf req-64c6b658-a046-41b8-bdfd-09eeb98a3fa6 service nova] Enqueued Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_rules [ 952.256346] env[71140]: INFO networking_nsxv3.common.synchronization [req-33a54027-99bc-4223-afd8-752baaa2dcdf req-64c6b658-a046-41b8-bdfd-09eeb98a3fa6 service nova] Enqueued Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 952.256346] env[71140]: INFO networking_nsxv3.common.synchronization [req-33a54027-99bc-4223-afd8-752baaa2dcdf req-64c6b658-a046-41b8-bdfd-09eeb98a3fa6 service nova] Enqueued Resource ID: 90d987bc-da15-40c1-99d7-29dca3ef3cab with Priority: HIGHEST for action port [ 952.256346] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_rules [ 952.256346] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 952.256346] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90d987bc-da15-40c1-99d7-29dca3ef3cab with Priority: HIGHEST for action port [ 952.256346] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.256346] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.257917] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.257917] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.258192] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-90d987bc-da15-40c1-99d7-29dca3ef3cab taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.259024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90d987bc-da15-40c1-99d7-29dca3ef3cab" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.259024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90d987bc-da15-40c1-99d7-29dca3ef3cab" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.259024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90d987bc-da15-40c1-99d7-29dca3ef3cab" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.259024] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90d987bc-da15-40c1-99d7-29dca3ef3cab',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.449586] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.552130] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.552130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.553551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.553551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.553551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.553551] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.553551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.553551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.553551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.553551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.553551] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 is going to be updated. [ 952.583355] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.583355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.583355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.583355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.583355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.589879] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: IN_PROGRESS for 2s [ 952.763802] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90d987bc-da15-40c1-99d7-29dca3ef3cab with status ACTIVE [ 952.764145] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.764296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.764368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.764629] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.764725] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.766136] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.766136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.766136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.766136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.766136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.766136] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.766136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.766136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.766136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.766136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.766136] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90d987bc-da15-40c1-99d7-29dca3ef3cab is going to be updated. [ 952.785497] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.785639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.785711] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.785926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.786093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.786277] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90d987bc-da15-40c1-99d7-29dca3ef3cab" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.952879] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.953075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.953181] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.953451] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.953550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.953655] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be updated. [ 952.961753] env[71140]: INFO networking_nsxv3.common.synchronization [req-290fe052-9baa-4a10-abe5-dd1d085820e0 req-638e9592-210b-41ba-b7b2-effc497df170 tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 952.962389] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 952.962700] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.962823] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.962895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.963234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.963390] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.963492] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.963555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.963718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.963808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.963903] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.981032] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.981032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.981032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.981032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.981032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.991822] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 953.300125] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: SUCCESS [ 953.300125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.300125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.300477] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.300477] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.300620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.300682] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.300852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.300935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.301079] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.301201] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.305747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.305747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.305747] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.305747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.305747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.305747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.305747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.305747] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.469298] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.469298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.469298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.469298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.469298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.469298] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.469298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.469298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.469298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.469298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.469298] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be updated. [ 953.497755] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.497755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.497755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.497755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.497755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.502682] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: IN_PROGRESS for 2s [ 953.803599] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.803599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.806925] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.309907] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.607231] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 in Status: SUCCESS [ 954.607447] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 deletion is rescheduled due to dependency. [ 954.607568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.817659] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.817659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.817659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.817659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.817659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.817659] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 is going to be updated. [ 954.852756] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.852756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.852756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.852756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.852756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.860411] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: IN_PROGRESS for 2s [ 955.006327] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 955.006627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.378445] env[71140]: INFO networking_nsxv3.common.synchronization [req-043c8c7f-7b99-49fc-b0ac-c38ae7a75488 req-d2a92441-93db-4f6f-8026-da37ee8452f6 tempest-ImagesNegativeTestJSON-1421730189 tempest-ImagesNegativeTestJSON-1421730189-project-member] Enqueued Resource ID: 6cb57d72-3644-432b-8c2c-9a03c173956e with Priority: HIGHEST for action security_group_members [ 955.379011] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cb57d72-3644-432b-8c2c-9a03c173956e with Priority: HIGHEST for action security_group_members [ 955.379333] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb57d72-3644-432b-8c2c-9a03c173956e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.379456] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.379514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.379776] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.379920] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.381049] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.381049] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.381049] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.381049] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.381049] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cb57d72-3644-432b-8c2c-9a03c173956e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.511366] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 955.511550] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 deletion is rescheduled due to dependency. [ 955.511668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.885794] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.889021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.889021] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cb57d72-3644-432b-8c2c-9a03c173956e already deleted. [ 955.889021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.905942] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.906148] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-269" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.906271] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-269" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.906583] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-269" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.906843] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.906996] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.907211] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.907441] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.907583] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.907791] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 955.909017] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 955.909017] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 955.909017] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 955.909017] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 955.909017] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 955.909017] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 955.927183] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 955.927395] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 955.927537] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 955.927734] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-269" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.928070] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-012c6887-e489-4caa-a0e3-6b444175698c taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.928259] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-012c6887-e489-4caa-a0e3-6b444175698c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.928384] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-012c6887-e489-4caa-a0e3-6b444175698c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.928719] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-012c6887-e489-4caa-a0e3-6b444175698c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.928862] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('012c6887-e489-4caa-a0e3-6b444175698c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.254493] env[71140]: INFO networking_nsxv3.common.synchronization [req-d081fd58-2b56-44b3-af6b-1a05b201b4df req-f461b4c4-7cbf-46fb-85ab-56189ca217fd tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 with Priority: HIGHEST for action security_group_members [ 956.255064] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 with Priority: HIGHEST for action security_group_members [ 956.255380] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcc20535-4cb4-4221-b041-8dd02e4b3787 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.255507] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.255574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.255772] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.255919] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.262626] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.262757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.262999] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.263139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.263417] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcc20535-4cb4-4221-b041-8dd02e4b3787',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.431531] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.431865] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.432522] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.432932] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.433107] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.433285] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 012c6887-e489-4caa-a0e3-6b444175698c not found, creating... [ 956.433581] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.433752] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.433875] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.434123] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.434285] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.434581] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.435260] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.435260] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.438213] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.438471] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.438652] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 012c6887-e489-4caa-a0e3-6b444175698c is going to be created. [ 956.460411] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.461280] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.461583] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.461975] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.462528] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.463512] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-012c6887-e489-4caa-a0e3-6b444175698c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.766487] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.766487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.766487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.766487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.766487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.766487] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.766487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.766487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.766487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.766487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.767210] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 is going to be updated. [ 956.801773] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.801773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.801773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.801773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.801773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.812255] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 in Status: IN_PROGRESS for 2s [ 956.871918] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: SUCCESS [ 956.871918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.871918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.871918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.871918] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.871918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.871918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.871918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.871918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.873035] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.375752] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.382269] env[71140]: INFO networking_nsxv3.common.synchronization [req-043c8c7f-7b99-49fc-b0ac-c38ae7a75488 req-3a26eea4-0f1f-4c40-82ca-d98971c8e9f1 service nova] Enqueued Resource ID: 6cb57d72-3644-432b-8c2c-9a03c173956e with Priority: HIGHEST for action security_group_rules [ 957.382543] env[71140]: INFO networking_nsxv3.common.synchronization [req-043c8c7f-7b99-49fc-b0ac-c38ae7a75488 req-3a26eea4-0f1f-4c40-82ca-d98971c8e9f1 service nova] Enqueued Resource ID: 6cb57d72-3644-432b-8c2c-9a03c173956e with Priority: HIGHEST for action security_group_members [ 957.382623] env[71140]: INFO networking_nsxv3.common.synchronization [req-043c8c7f-7b99-49fc-b0ac-c38ae7a75488 req-3a26eea4-0f1f-4c40-82ca-d98971c8e9f1 service nova] Enqueued Resource ID: 012c6887-e489-4caa-a0e3-6b444175698c with Priority: HIGHEST for action port [ 957.384039] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cb57d72-3644-432b-8c2c-9a03c173956e with Priority: HIGHEST for action security_group_rules [ 957.384039] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cb57d72-3644-432b-8c2c-9a03c173956e with Priority: HIGHEST for action security_group_members [ 957.384039] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012c6887-e489-4caa-a0e3-6b444175698c with Priority: HIGHEST for action port [ 957.384039] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cb57d72-3644-432b-8c2c-9a03c173956e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.384039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.384393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.384464] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.384562] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cb57d72-3644-432b-8c2c-9a03c173956e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.385478] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb57d72-3644-432b-8c2c-9a03c173956e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.385555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.385626] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.385861] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.385990] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.386097] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.386162] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.386305] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.386390] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.386481] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cb57d72-3644-432b-8c2c-9a03c173956e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.390027] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-012c6887-e489-4caa-a0e3-6b444175698c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.390027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-012c6887-e489-4caa-a0e3-6b444175698c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.390027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-012c6887-e489-4caa-a0e3-6b444175698c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.390027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-012c6887-e489-4caa-a0e3-6b444175698c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.390027] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('012c6887-e489-4caa-a0e3-6b444175698c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.880436] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.890055] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb57d72-3644-432b-8c2c-9a03c173956e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.890309] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.892088] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6cb57d72-3644-432b-8c2c-9a03c173956e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.894784] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 012c6887-e489-4caa-a0e3-6b444175698c with status ACTIVE [ 957.894784] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.894784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.894784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.895483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.895681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.895953] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.896254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.896385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.896607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.896778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.897054] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.897263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.897380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.897615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.897739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.897889] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 012c6887-e489-4caa-a0e3-6b444175698c is going to be updated. [ 957.918749] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.919138] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.919287] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.919802] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.920011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.920243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-012c6887-e489-4caa-a0e3-6b444175698c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.383634] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.383798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.383891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.384231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.384393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.384546] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 is going to be updated. [ 958.402408] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6cb57d72-3644-432b-8c2c-9a03c173956e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.412055] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.412268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.412368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.412557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.412827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.422160] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: IN_PROGRESS for 2s [ 958.826798] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 in Status: SUCCESS [ 958.826798] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 deletion is rescheduled due to dependency. [ 958.826798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.904605] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.905191] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.905191] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.905191] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.905191] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.905383] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cb57d72-3644-432b-8c2c-9a03c173956e is going to be created. [ 958.936283] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.936441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.936515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.936742] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.936891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.948059] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cb57d72-3644-432b-8c2c-9a03c173956e in Status: UNINITIALIZED for 2s [ 960.434023] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: SUCCESS [ 960.434023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.434023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.434023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.434023] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.434023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.434023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.434023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.434023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.434023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.434023] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.434023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.434023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.434023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.434023] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.434023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.434023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.435131] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.436375] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.436375] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.436375] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.939435] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 878a96b3-04c2-49e0-a7d2-cbbb47bf5319: rpc.has_security_group_logging(os_id): False [ 960.960185] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cb57d72-3644-432b-8c2c-9a03c173956e in Status: SUCCESS [ 960.960825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.961605] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.961745] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.961817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.962040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.962133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.962317] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.962515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.962631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.962826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.962908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.963460] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.963608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.963687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.963865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.963946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.964309] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.964497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.964497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.964628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.964705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.964955] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 is going to be created. [ 960.967146] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.967401] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.967527] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.967636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.967747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.967837] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.967921] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.968019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.968234] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6cb57d72-3644-432b-8c2c-9a03c173956e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.025174] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.025174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.025174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.025174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.025174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.034990] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: IN_PROGRESS for 2s [ 961.153663] env[71140]: INFO networking_nsxv3.common.synchronization [None req-c6452164-293a-493d-8205-171e4599b448 None None] Enqueued Resource ID: cebea9bd-295f-4ccb-900e-975740e18881 with Priority: HIGHEST for action port [ 961.153663] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cebea9bd-295f-4ccb-900e-975740e18881 with Priority: HIGHEST for action port [ 961.153663] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-cebea9bd-295f-4ccb-900e-975740e18881 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.153663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cebea9bd-295f-4ccb-900e-975740e18881" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.153663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cebea9bd-295f-4ccb-900e-975740e18881" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.155519] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cebea9bd-295f-4ccb-900e-975740e18881" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.155519] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cebea9bd-295f-4ccb-900e-975740e18881',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.218873] env[71140]: INFO networking_nsxv3.common.synchronization [req-e536f5b1-a5e9-4b97-b2cc-12037b9b456e req-90e8da03-6bdc-4bc5-be96-f79bae4e3df1 tempest-ServersTestJSON-593331045 tempest-ServersTestJSON-593331045-project-member] Enqueued Resource ID: a6eb3617-ce46-425c-b053-a5240fa9c14e with Priority: HIGHEST for action security_group_members [ 961.219476] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6eb3617-ce46-425c-b053-a5240fa9c14e with Priority: HIGHEST for action security_group_members [ 961.219941] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6eb3617-ce46-425c-b053-a5240fa9c14e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.219941] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.220185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.220566] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.220812] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.220812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.220988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.221328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.221328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.221328] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6eb3617-ce46-425c-b053-a5240fa9c14e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.470320] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb57d72-3644-432b-8c2c-9a03c173956e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.470984] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.470984] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.470984] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.470984] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.471154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.471154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.471388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.471388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.471652] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.471652] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb57d72-3644-432b-8c2c-9a03c173956e taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.471747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.476075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.476384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.476585] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.476717] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.476811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.476999] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.477130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.477187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.477270] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6cb57d72-3644-432b-8c2c-9a03c173956e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.656722] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cebea9bd-295f-4ccb-900e-975740e18881 [ 961.657294] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.657294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.657294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.657657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.657657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.657824] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cebea9bd-295f-4ccb-900e-975740e18881 already deleted. [ 961.657824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cebea9bd-295f-4ccb-900e-975740e18881" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.723202] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.723362] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.723441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.723664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.723774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.723963] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.724090] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.724141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.724306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.728018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.728018] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6eb3617-ce46-425c-b053-a5240fa9c14e is going to be updated. [ 961.759607] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.759607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.759897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.761355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.761355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.774620] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6eb3617-ce46-425c-b053-a5240fa9c14e in Status: IN_PROGRESS for 2s [ 961.982501] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6cb57d72-3644-432b-8c2c-9a03c173956e: rpc.has_security_group_logging(os_id): False [ 961.999175] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.999175] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.999175] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.999343] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.999373] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.999587] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.999675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.999748] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.000664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.000664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.000664] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.000664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.000664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.000664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.000664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.000924] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.000924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.000924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.001051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.002167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.002347] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cb57d72-3644-432b-8c2c-9a03c173956e is going to be created. [ 962.055636] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.055792] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.055865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.056124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.056325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.067020] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cb57d72-3644-432b-8c2c-9a03c173956e in Status: IN_PROGRESS for 2s [ 962.414669] env[71140]: INFO networking_nsxv3.common.synchronization [None req-3235af52-8e2c-4d7f-a002-49cf27c720fc tempest-ServersV294TestFqdnHostnames-519452335 tempest-ServersV294TestFqdnHostnames-519452335-project-member] Enqueued Resource ID: f3b2c834-9214-45cf-a32f-db5f411105f6 with Priority: HIGHEST for action security_group_rules [ 962.415224] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b2c834-9214-45cf-a32f-db5f411105f6 with Priority: HIGHEST for action security_group_rules [ 962.415548] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3b2c834-9214-45cf-a32f-db5f411105f6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.415670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.415738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.416033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.416190] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3b2c834-9214-45cf-a32f-db5f411105f6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.631067] env[71140]: INFO networking_nsxv3.common.synchronization [None req-1f24dfda-491e-44cc-9170-48e657df4bde tempest-ServersV294TestFqdnHostnames-519452335 tempest-ServersV294TestFqdnHostnames-519452335-project-member] Enqueued Resource ID: f3b2c834-9214-45cf-a32f-db5f411105f6 with Priority: HIGHEST for action security_group_rules [ 962.633975] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b2c834-9214-45cf-a32f-db5f411105f6 with Priority: HIGHEST for action security_group_rules [ 962.635086] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3b2c834-9214-45cf-a32f-db5f411105f6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.635284] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.938572] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.938721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.938793] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.939026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.939187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.939234] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3b2c834-9214-45cf-a32f-db5f411105f6 already deleted. [ 962.939296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.939441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.939600] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.939720] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3b2c834-9214-45cf-a32f-db5f411105f6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.047616] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: SUCCESS [ 963.048026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.048256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.048533] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.048669] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.238162] env[71140]: INFO networking_nsxv3.common.synchronization [None req-b77ce1d6-4559-42fe-b40c-228b14478289 None None] Enqueued Resource ID: 1dd18c32-4272-4cfb-819e-69ebea3ac829 with Priority: HIGHEST for action port [ 963.238612] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd18c32-4272-4cfb-819e-69ebea3ac829 with Priority: HIGHEST for action port [ 963.238853] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-1dd18c32-4272-4cfb-819e-69ebea3ac829 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.238970] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1dd18c32-4272-4cfb-819e-69ebea3ac829" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.239061] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1dd18c32-4272-4cfb-819e-69ebea3ac829" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.239375] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1dd18c32-4272-4cfb-819e-69ebea3ac829" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.239453] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dd18c32-4272-4cfb-819e-69ebea3ac829',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.425089] env[71140]: INFO networking_nsxv3.common.synchronization [req-024e5e31-7487-4cb4-8a88-da8084dba9e8 req-837480b2-3184-4883-bed9-de56d6ba6cc0 tempest-MultipleCreateTestJSON-727311014 tempest-MultipleCreateTestJSON-727311014-project-member] Enqueued Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 963.429377] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 963.429377] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.429377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.429377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.429377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.429377] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.429377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.429377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.429377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.429377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.429377] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.467026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.467026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.467026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.467026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.467026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.467026] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3b2c834-9214-45cf-a32f-db5f411105f6 already deleted. [ 963.467026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.552086] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.552334] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.743347] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1dd18c32-4272-4cfb-819e-69ebea3ac829 [ 963.743674] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.743816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.743882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.744107] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.744195] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.744351] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1dd18c32-4272-4cfb-819e-69ebea3ac829 already deleted. [ 963.744511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1dd18c32-4272-4cfb-819e-69ebea3ac829" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.785467] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6eb3617-ce46-425c-b053-a5240fa9c14e in Status: SUCCESS [ 963.785714] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6eb3617-ce46-425c-b053-a5240fa9c14e deletion is rescheduled due to dependency. [ 963.785789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6eb3617-ce46-425c-b053-a5240fa9c14e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.934485] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.953028] env[71140]: INFO networking_nsxv3.common.synchronization [req-f855418e-5823-4a03-b594-6d7143aacefc req-0ea9b0fb-3fd5-46eb-80ca-6813e1be61fa tempest-MultipleCreateTestJSON-727311014 tempest-MultipleCreateTestJSON-727311014-project-member] Enqueued Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 963.953355] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 963.953663] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.953768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.081175] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cb57d72-3644-432b-8c2c-9a03c173956e in Status: SUCCESS [ 964.081457] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.436410] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.478466] env[71140]: INFO networking_nsxv3.common.synchronization [req-5e9a9642-4779-4dfb-92d1-a18440dcb0b3 req-47bac727-8da0-411b-9fe5-e2f294ab00da tempest-ServerDiskConfigTestJSON-63292790 tempest-ServerDiskConfigTestJSON-63292790-project-member] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 964.479175] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 964.479560] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.479687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.479754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.479952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.481307] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.481440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.481533] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.481826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.481896] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.482043] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.938911] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.939296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.939296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.939296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.939424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.939480] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 is going to be updated. [ 964.964254] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.964392] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.964577] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.964682] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.964813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.972762] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: IN_PROGRESS for 2s [ 964.984379] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.984605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.984605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.984814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.984900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.985134] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.985247] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.985305] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.985460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.985534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.985618] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 965.007719] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.007909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.007994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.008187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.008340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.017561] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 965.083577] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.083789] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.083920] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.084233] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.084502] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.084669] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.084782] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.085017] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.085308] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.085548] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 965.085668] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 965.085783] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 965.085896] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 965.086021] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 965.086131] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 965.086272] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 965.116126] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 965.116126] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 965.116126] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 965.116126] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.116126] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-ea433764-da56-468e-8849-8a2db189a4e9 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.116126] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-ea433764-da56-468e-8849-8a2db189a4e9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.116126] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-ea433764-da56-468e-8849-8a2db189a4e9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.116126] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-ea433764-da56-468e-8849-8a2db189a4e9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.116126] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea433764-da56-468e-8849-8a2db189a4e9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.621578] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.621578] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.621578] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.621578] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.621578] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.621578] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port ea433764-da56-468e-8849-8a2db189a4e9 not found, creating... [ 965.621578] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.621578] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.621578] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.622529] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.622983] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.623778] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.624386] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.629557] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.629557] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.629557] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.629557] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: ea433764-da56-468e-8849-8a2db189a4e9 is going to be created. [ 965.648844] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.649319] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.649435] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.649797] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.650402] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.650402] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-ea433764-da56-468e-8849-8a2db189a4e9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.023315] env[71140]: INFO networking_nsxv3.common.synchronization [None req-a862c1f1-d7c4-4db3-8b0a-9c0b2df41d87 None None] Enqueued Resource ID: 91f9f9c5-d017-4975-8634-4d0b74a3a2ec with Priority: HIGHEST for action port [ 966.023649] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91f9f9c5-d017-4975-8634-4d0b74a3a2ec with Priority: HIGHEST for action port [ 966.023962] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-91f9f9c5-d017-4975-8634-4d0b74a3a2ec taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.026948] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91f9f9c5-d017-4975-8634-4d0b74a3a2ec" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.026948] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91f9f9c5-d017-4975-8634-4d0b74a3a2ec" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.027206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91f9f9c5-d017-4975-8634-4d0b74a3a2ec" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.027324] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91f9f9c5-d017-4975-8634-4d0b74a3a2ec',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.531945] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91f9f9c5-d017-4975-8634-4d0b74a3a2ec [ 966.532206] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.532349] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.532419] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.532633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.532726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.532821] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91f9f9c5-d017-4975-8634-4d0b74a3a2ec already deleted. [ 966.532899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91f9f9c5-d017-4975-8634-4d0b74a3a2ec" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.808676] env[71140]: INFO networking_nsxv3.common.synchronization [req-5e9a9642-4779-4dfb-92d1-a18440dcb0b3 req-a7351ce2-dc3c-4595-83ed-86169d864804 service nova] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_rules [ 966.808885] env[71140]: INFO networking_nsxv3.common.synchronization [req-5e9a9642-4779-4dfb-92d1-a18440dcb0b3 req-a7351ce2-dc3c-4595-83ed-86169d864804 service nova] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 966.809020] env[71140]: INFO networking_nsxv3.common.synchronization [req-5e9a9642-4779-4dfb-92d1-a18440dcb0b3 req-a7351ce2-dc3c-4595-83ed-86169d864804 service nova] Enqueued Resource ID: ea433764-da56-468e-8849-8a2db189a4e9 with Priority: HIGHEST for action port [ 966.809613] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_rules [ 966.809742] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 966.809834] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea433764-da56-468e-8849-8a2db189a4e9 with Priority: HIGHEST for action port [ 966.814121] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.814121] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.814121] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.814121] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.814121] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.814121] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.814121] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.814121] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea433764-da56-468e-8849-8a2db189a4e9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.814121] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea433764-da56-468e-8849-8a2db189a4e9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.814121] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea433764-da56-468e-8849-8a2db189a4e9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.814121] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea433764-da56-468e-8849-8a2db189a4e9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.814121] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea433764-da56-468e-8849-8a2db189a4e9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.986682] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: SUCCESS [ 966.986789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.986915] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.988685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.988685] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.988685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.988685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.988685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.988685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.988685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.988685] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.989396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.990605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.992036] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.992036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.992036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.992036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.992036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.992036] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.030691] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 967.030971] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 deletion is rescheduled due to dependency. [ 967.030971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.030971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.031257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.031445] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.031561] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.031622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.031775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.031852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.031945] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.315281] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.315697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.317605] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea433764-da56-468e-8849-8a2db189a4e9 with status ACTIVE [ 967.319034] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.319034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.319034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.319034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.319034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.319034] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.319034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.319034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.319034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.319538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.319538] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.319538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.319538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.319538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.319696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.319696] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea433764-da56-468e-8849-8a2db189a4e9 is going to be updated. [ 967.333965] env[71140]: INFO networking_nsxv3.common.synchronization [None req-dfd894e4-fd5d-4dd0-9430-f8696b3b71f7 tempest-ServerActionsTestOtherA-289074452 tempest-ServerActionsTestOtherA-289074452-project-member] Enqueued Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_rules [ 967.334457] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_rules [ 967.334692] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-893ec538-5364-452f-9431-cbce81e1231d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.337020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.337020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.339208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.339298] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.341863] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.341863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.341863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.342163] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.342163] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.342227] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea433764-da56-468e-8849-8a2db189a4e9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.450786] env[71140]: INFO networking_nsxv3.common.synchronization [None req-ebf35038-de7b-4b8d-b2f8-bc7fc4290211 tempest-ServerActionsTestOtherA-289074452 tempest-ServerActionsTestOtherA-289074452-project-member] Enqueued Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_rules [ 967.451359] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_rules [ 967.451670] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-893ec538-5364-452f-9431-cbce81e1231d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.451775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.497022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.497022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.497022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.497022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.497022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.497022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.497022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.497022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.497022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.497022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.497022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.497022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.497022] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 is going to be updated. [ 967.524417] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.524417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.524417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.524417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.524417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.529887] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: IN_PROGRESS for 2s [ 967.535235] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.864903] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.865057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.865108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.865895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.865895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.865895] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 893ec538-5364-452f-9431-cbce81e1231d already deleted. [ 967.865895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.865895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.866085] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.866085] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.038040] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.387742] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.387950] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.388052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.388344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.388441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.388994] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 893ec538-5364-452f-9431-cbce81e1231d already deleted. [ 968.389180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.540662] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.541396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.541396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.541596] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.541709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.541816] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 968.568888] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.569137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.569218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.569502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.570015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.578902] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 968.723900] env[71140]: INFO networking_nsxv3.common.synchronization [None req-94c34e0c-dd0b-4eed-8865-0b9c45767ebe None None] Enqueued Resource ID: 6a004ea9-f0cd-400b-b677-5314b2c0183f with Priority: HIGHEST for action port [ 968.724196] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a004ea9-f0cd-400b-b677-5314b2c0183f with Priority: HIGHEST for action port [ 968.724747] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a004ea9-f0cd-400b-b677-5314b2c0183f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.724890] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a004ea9-f0cd-400b-b677-5314b2c0183f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.724942] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a004ea9-f0cd-400b-b677-5314b2c0183f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.725957] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a004ea9-f0cd-400b-b677-5314b2c0183f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.725957] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a004ea9-f0cd-400b-b677-5314b2c0183f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.227789] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a004ea9-f0cd-400b-b677-5314b2c0183f [ 969.227789] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.227789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.227789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.227789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.228235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.228235] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a004ea9-f0cd-400b-b677-5314b2c0183f already deleted. [ 969.228235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a004ea9-f0cd-400b-b677-5314b2c0183f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.258060] env[71140]: INFO networking_nsxv3.common.synchronization [req-1c0a643a-8a40-40c0-b516-e50467b7ed28 req-f545e3da-5781-4f9d-84f8-b4ab0acfc46b tempest-ImagesNegativeTestJSON-1421730189 tempest-ImagesNegativeTestJSON-1421730189-project-member] Enqueued Resource ID: 6cb57d72-3644-432b-8c2c-9a03c173956e with Priority: HIGHEST for action security_group_members [ 969.258826] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cb57d72-3644-432b-8c2c-9a03c173956e with Priority: HIGHEST for action security_group_members [ 969.258959] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb57d72-3644-432b-8c2c-9a03c173956e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.259140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.259234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.259452] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.259634] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.259759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.259893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.260069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.260982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.260982] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cb57d72-3644-432b-8c2c-9a03c173956e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.540341] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: SUCCESS [ 969.540568] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 deletion is rescheduled due to dependency. [ 969.540736] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.541253] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.541483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.541681] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.541808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.541882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.542055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.542152] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.542240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.542395] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.542489] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.542550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.542766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.542825] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.542918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.542973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.543496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.543678] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.543804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.543936] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.765481] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.765638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.765699] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.766458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.766458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.766458] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.766458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.766458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.766719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.766719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.766719] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cb57d72-3644-432b-8c2c-9a03c173956e is going to be updated. [ 969.794669] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.794849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.794924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.796325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.796496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.806979] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cb57d72-3644-432b-8c2c-9a03c173956e in Status: IN_PROGRESS for 2s [ 970.046524] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 878a96b3-04c2-49e0-a7d2-cbbb47bf5319: rpc.has_security_group_logging(os_id): False [ 970.064231] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.064388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.064448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.064648] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.064738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.064928] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.065042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.065116] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.065282] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.065365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.065575] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.065671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.065730] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.065870] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.065946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.066157] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.066275] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.066340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.066485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.066558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.066643] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 is going to be updated. [ 970.121915] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.122721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.122721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.122721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.122721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.136398] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: IN_PROGRESS for 2s [ 970.588166] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 970.588434] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.588581] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.588790] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.588975] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.589105] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.589174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.589335] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.589438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.589519] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.589611] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.092324] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.092936] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.093137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.094160] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.094333] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.094491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.094563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.094747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.094842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.094974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.095221] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.095332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.095407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.095609] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.095764] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.095868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.095932] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.096099] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.096925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.096925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.096925] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.222481] env[71140]: INFO networking_nsxv3.common.synchronization [req-b5057ce7-9af4-4b52-a0aa-fb8ef9cd467b req-db14328b-01b2-4545-bc7e-7f01d8714cc1 tempest-ImagesTestJSON-1376189349 tempest-ImagesTestJSON-1376189349-project-member] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 971.223250] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 971.223510] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.223631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.223699] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.223952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.224120] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.224212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.224275] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.224423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.224899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.224899] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.600523] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2975c43-5d19-4643-8076-5d24f0ea84c6: rpc.has_security_group_logging(os_id): False [ 971.623021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.623167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.623236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.623439] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.623529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.623721] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.625034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.625034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.625034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.625034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.625034] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.625034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.625034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.625034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.625034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.625377] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.625377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.625377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.625738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.626219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.626384] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 971.693164] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.693347] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.693388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.693586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.693730] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.717266] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 971.726816] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.727018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.727158] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.727407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.728444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.728444] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.728444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.728444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.728444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.728444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.728444] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be updated. [ 971.760392] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.760552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.760603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.760798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.760935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.770949] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 971.833480] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cb57d72-3644-432b-8c2c-9a03c173956e in Status: SUCCESS [ 971.833480] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cb57d72-3644-432b-8c2c-9a03c173956e deletion is rescheduled due to dependency. [ 971.833480] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb57d72-3644-432b-8c2c-9a03c173956e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.153418] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: SUCCESS [ 972.153655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.311081] env[71140]: INFO networking_nsxv3.common.synchronization [None req-57331962-94c3-4f69-bf3a-9e568daccb6d tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a with Priority: HIGHEST for action security_group_rules [ 973.311398] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a with Priority: HIGHEST for action security_group_rules [ 973.311786] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66227fe8-4a5f-47ba-add3-defc26d5bd6a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.311786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.311897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.312207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.312207] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66227fe8-4a5f-47ba-add3-defc26d5bd6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.411975] env[71140]: INFO networking_nsxv3.common.synchronization [None req-0c0b6cc5-daa1-4d6c-bf80-0e012a4ea761 tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a with Priority: HIGHEST for action security_group_rules [ 973.412481] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a with Priority: HIGHEST for action security_group_rules [ 973.413179] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66227fe8-4a5f-47ba-add3-defc26d5bd6a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.413179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.733847] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 973.734116] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.781414] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 973.781692] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 deletion is rescheduled due to dependency. [ 973.781692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.833428] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.833706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.833706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.833857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.833951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.834068] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a already deleted. [ 973.834140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.834361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.834459] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.834543] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66227fe8-4a5f-47ba-add3-defc26d5bd6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.360888] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.361260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.361260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.361438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.361642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.361642] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a already deleted. [ 974.361725] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.750428] env[71140]: INFO networking_nsxv3.common.synchronization [req-e676a121-1846-4a85-aedd-1d8c0a609102 req-991590b9-4ba0-4ab4-9a66-33ad8e540ff7 tempest-AttachVolumeNegativeTest-950002537 tempest-AttachVolumeNegativeTest-950002537-project-member] Enqueued Resource ID: e42db4b7-b71b-4297-acb7-b4910e7af664 with Priority: HIGHEST for action security_group_members [ 974.750943] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42db4b7-b71b-4297-acb7-b4910e7af664 with Priority: HIGHEST for action security_group_members [ 974.751262] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42db4b7-b71b-4297-acb7-b4910e7af664 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.753032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.753032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.753032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.753032] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.753032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.753032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.753032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.753032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.753032] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42db4b7-b71b-4297-acb7-b4910e7af664',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.257525] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.257684] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.257754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.258675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.258675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.258893] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.259012] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.259078] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.259254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.259337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.259423] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42db4b7-b71b-4297-acb7-b4910e7af664 is going to be updated. [ 975.287101] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.287479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.287701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.288050] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.289028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.300788] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42db4b7-b71b-4297-acb7-b4910e7af664 in Status: IN_PROGRESS for 2s [ 975.604818] env[71140]: INFO networking_nsxv3.common.synchronization [req-e8cad7af-b67d-44f6-91d7-fdf0fe43f1db req-cc3a43cf-2117-4cf4-be4c-70613dc92c08 tempest-ServerActionsTestOtherB-2025667431 tempest-ServerActionsTestOtherB-2025667431-project-member] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 975.605377] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 975.605681] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.605817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.605888] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.606230] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.606392] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.606668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.606792] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.606953] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.607051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.607200] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.899884] env[71140]: INFO networking_nsxv3.common.synchronization [None req-ad27351e-f97d-49f9-b1f3-679091e8e5c5 None None] Enqueued Resource ID: 1fa8dfea-5c97-487b-bf2f-2fd955c85155 with Priority: HIGHEST for action port [ 975.900056] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fa8dfea-5c97-487b-bf2f-2fd955c85155 with Priority: HIGHEST for action port [ 975.900622] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fa8dfea-5c97-487b-bf2f-2fd955c85155 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.900747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fa8dfea-5c97-487b-bf2f-2fd955c85155" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.900809] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fa8dfea-5c97-487b-bf2f-2fd955c85155" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.901364] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fa8dfea-5c97-487b-bf2f-2fd955c85155" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.901457] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fa8dfea-5c97-487b-bf2f-2fd955c85155',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.109168] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.109347] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.109412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.109607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.109693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.109885] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.109987] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.110060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.110193] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.110268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.110357] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c is going to be updated. [ 976.136263] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.136263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.136459] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.137512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.137512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.144302] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: IN_PROGRESS for 2s [ 976.185360] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.185745] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.185745] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.188022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.188022] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.188022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.188022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.188022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.188022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.188022] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 976.188022] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.188022] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.188022] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.188022] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 976.188022] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.188876] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.214648] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.215438] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 976.215438] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.215629] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.216652] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-7041e488-b42c-46b0-ab2f-e5a7e798727b taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.216875] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-7041e488-b42c-46b0-ab2f-e5a7e798727b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.218242] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-7041e488-b42c-46b0-ab2f-e5a7e798727b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.218242] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-7041e488-b42c-46b0-ab2f-e5a7e798727b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.218242] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7041e488-b42c-46b0-ab2f-e5a7e798727b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.459482] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fa8dfea-5c97-487b-bf2f-2fd955c85155 [ 976.459482] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.459482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.459482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.459482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.459482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.459482] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fa8dfea-5c97-487b-bf2f-2fd955c85155 already deleted. [ 976.459482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fa8dfea-5c97-487b-bf2f-2fd955c85155" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.720689] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.721055] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.721107] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.721367] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.721528] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.721753] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 7041e488-b42c-46b0-ab2f-e5a7e798727b not found, creating... [ 976.722073] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.722247] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.722375] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.722636] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.722840] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.723175] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.723350] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.723466] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.723812] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.723812] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.723966] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 7041e488-b42c-46b0-ab2f-e5a7e798727b is going to be created. [ 976.745643] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.745643] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.745823] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.745973] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.746226] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.746464] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-7041e488-b42c-46b0-ab2f-e5a7e798727b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.861713] env[71140]: INFO networking_nsxv3.common.synchronization [None req-a30db657-94ee-41f4-8893-bc7977aaf6f1 tempest-AttachVolumeTestJSON-775620922 tempest-AttachVolumeTestJSON-775620922-project-member] Enqueued Resource ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 with Priority: HIGHEST for action security_group_rules [ 976.862239] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 with Priority: HIGHEST for action security_group_rules [ 976.862562] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.862683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.862747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.862989] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.864145] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9372f7d-fcc5-4703-b77d-bbb4d1695328',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.969810] env[71140]: INFO networking_nsxv3.common.synchronization [None req-42decfeb-827e-492a-a117-489894bc5d39 tempest-AttachVolumeTestJSON-775620922 tempest-AttachVolumeTestJSON-775620922-project-member] Enqueued Resource ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 with Priority: HIGHEST for action security_group_rules [ 976.971052] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 with Priority: HIGHEST for action security_group_rules [ 976.971052] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.971052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.311213] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42db4b7-b71b-4297-acb7-b4910e7af664 in Status: SUCCESS [ 977.311393] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42db4b7-b71b-4297-acb7-b4910e7af664 deletion is rescheduled due to dependency. [ 977.311505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.385759] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.385759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.385759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.385759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.385759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.385759] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 already deleted. [ 977.385759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.385759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.385759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.385759] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9372f7d-fcc5-4703-b77d-bbb4d1695328',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.596475] env[71140]: INFO networking_nsxv3.common.synchronization [req-e8cad7af-b67d-44f6-91d7-fdf0fe43f1db req-e0ec1cee-04c0-426b-bcb8-aa81ea3a6408 service nova] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_rules [ 977.596475] env[71140]: INFO networking_nsxv3.common.synchronization [req-e8cad7af-b67d-44f6-91d7-fdf0fe43f1db req-e0ec1cee-04c0-426b-bcb8-aa81ea3a6408 service nova] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 977.596475] env[71140]: INFO networking_nsxv3.common.synchronization [req-e8cad7af-b67d-44f6-91d7-fdf0fe43f1db req-e0ec1cee-04c0-426b-bcb8-aa81ea3a6408 service nova] Enqueued Resource ID: 7041e488-b42c-46b0-ab2f-e5a7e798727b with Priority: HIGHEST for action port [ 977.596703] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_rules [ 977.596813] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 977.597049] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7041e488-b42c-46b0-ab2f-e5a7e798727b with Priority: HIGHEST for action port [ 977.597511] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.597634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.597695] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.597962] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.598040] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.599194] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.599194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.599335] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-7041e488-b42c-46b0-ab2f-e5a7e798727b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.599437] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7041e488-b42c-46b0-ab2f-e5a7e798727b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.599511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7041e488-b42c-46b0-ab2f-e5a7e798727b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.599698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7041e488-b42c-46b0-ab2f-e5a7e798727b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.599772] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7041e488-b42c-46b0-ab2f-e5a7e798727b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.904667] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.904941] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.904941] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.905238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.905376] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.905562] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 already deleted. [ 977.905701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.950878] env[71140]: INFO networking_nsxv3.common.synchronization [None req-81187bc8-fd79-4c3c-8bf1-bc335ae8094a None None] Enqueued Resource ID: c590423f-535e-4d37-b0ec-3a2ebe0fd6fb with Priority: HIGHEST for action port [ 977.951154] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c590423f-535e-4d37-b0ec-3a2ebe0fd6fb with Priority: HIGHEST for action port [ 977.951704] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-c590423f-535e-4d37-b0ec-3a2ebe0fd6fb taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.951827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c590423f-535e-4d37-b0ec-3a2ebe0fd6fb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.951975] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c590423f-535e-4d37-b0ec-3a2ebe0fd6fb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.953333] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c590423f-535e-4d37-b0ec-3a2ebe0fd6fb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.953458] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c590423f-535e-4d37-b0ec-3a2ebe0fd6fb',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.101908] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.102237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.102887] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7041e488-b42c-46b0-ab2f-e5a7e798727b with status ACTIVE [ 978.102996] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.103135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.103205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.103413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.103505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.103676] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.103764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.103832] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.104240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.104860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.105109] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.105224] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.105292] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.105447] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.105525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.105943] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7041e488-b42c-46b0-ab2f-e5a7e798727b is going to be updated. [ 978.126223] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.126395] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.126483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.126634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.126770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.126932] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7041e488-b42c-46b0-ab2f-e5a7e798727b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.154635] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: SUCCESS [ 978.157014] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c deletion is rescheduled due to dependency. [ 978.157014] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.157014] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.157014] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.157014] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.157014] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.157014] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.157014] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.157014] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.157014] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.458871] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c590423f-535e-4d37-b0ec-3a2ebe0fd6fb [ 978.459197] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.459372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.459463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.459729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.459842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.459960] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c590423f-535e-4d37-b0ec-3a2ebe0fd6fb already deleted. [ 978.460086] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c590423f-535e-4d37-b0ec-3a2ebe0fd6fb" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.657874] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.161550] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.664205] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.664205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.664205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.664205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.664205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.664205] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c is going to be updated. [ 979.691019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.691179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.691255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.693046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.693046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.704023] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: IN_PROGRESS for 2s [ 981.715336] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: SUCCESS [ 981.715336] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.715336] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.715336] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.715336] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.715787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.715787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.715787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.715787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.715923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.715969] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.218564] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.653610] env[71140]: INFO networking_nsxv3.common.synchronization [req-c1510e55-5465-4a34-b7d8-2b5eca7c3f0f req-0367227d-02de-4074-a725-5b7a469479a9 tempest-DeleteServersTestJSON-1199867382 tempest-DeleteServersTestJSON-1199867382-project-member] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 982.654206] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 982.654765] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.654765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.654765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.655031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.655190] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.655310] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.655377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.655563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.656025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.656025] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.720799] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c99ec8b-0259-4916-a240-54938fc5a81c: rpc.has_security_group_logging(os_id): False [ 982.739179] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.739333] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.739333] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.739583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.739736] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.740027] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.740137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.740205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.740376] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.740456] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.740541] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c is going to be updated. [ 982.794338] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.794561] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.794561] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.794795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.794904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.808872] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: IN_PROGRESS for 2s [ 983.157661] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.157826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.157877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.158148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.158236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.158453] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.158554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.158616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.158778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.158855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.158942] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be updated. [ 983.182843] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.182997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.183054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.183251] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.183387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.193688] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 984.822110] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: SUCCESS [ 984.822461] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.204190] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 985.204334] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 deletion is rescheduled due to dependency. [ 985.204437] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.277656] env[71140]: INFO networking_nsxv3.common.synchronization [req-6d24b103-323b-4cee-9dd3-f7a51bbf280c req-34d1ff07-12a5-44d5-be1b-5c40e56384d7 tempest-ServersV294TestFqdnHostnames-519452335 tempest-ServersV294TestFqdnHostnames-519452335-project-member] Enqueued Resource ID: f3b2c834-9214-45cf-a32f-db5f411105f6 with Priority: HIGHEST for action security_group_members [ 986.278205] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b2c834-9214-45cf-a32f-db5f411105f6 with Priority: HIGHEST for action security_group_members [ 986.278500] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b2c834-9214-45cf-a32f-db5f411105f6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.278622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.278689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.278945] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.279117] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.279220] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.279287] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.279436] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.279522] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.279937] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b2c834-9214-45cf-a32f-db5f411105f6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.729161] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-220 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.729419] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-220" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.729560] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-220" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.729932] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-220" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.730250] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.730472] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.730614] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.730802] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.730954] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.732126] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.732126] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.732126] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.732126] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.732126] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.732126] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.732126] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.752854] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.753030] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 986.753180] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.753360] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-220" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.753660] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-d1c9d542-28b0-4743-bb8a-af20ecf99f3e taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.753826] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-d1c9d542-28b0-4743-bb8a-af20ecf99f3e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.753958] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-d1c9d542-28b0-4743-bb8a-af20ecf99f3e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.754306] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-d1c9d542-28b0-4743-bb8a-af20ecf99f3e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.754448] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1c9d542-28b0-4743-bb8a-af20ecf99f3e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.783240] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.783240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.783240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.783240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.783240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.783594] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.783594] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.783594] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.783702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.783732] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.783914] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b2c834-9214-45cf-a32f-db5f411105f6 already deleted. [ 986.783914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.262282] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.262503] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.262634] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.262910] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.263077] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.263243] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port d1c9d542-28b0-4743-bb8a-af20ecf99f3e not found, creating... [ 987.263501] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.263662] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.263784] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.264017] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.264168] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.264461] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.264621] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.264776] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.264960] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.265118] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.265264] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: d1c9d542-28b0-4743-bb8a-af20ecf99f3e is going to be created. [ 987.284397] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.284717] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.284717] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.284926] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.285162] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.285379] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-d1c9d542-28b0-4743-bb8a-af20ecf99f3e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.034800] env[71140]: INFO networking_nsxv3.common.synchronization [req-6d24b103-323b-4cee-9dd3-f7a51bbf280c req-42111287-bf83-4cf4-b7c2-f18b6c6b11eb service nova] Enqueued Resource ID: f3b2c834-9214-45cf-a32f-db5f411105f6 with Priority: HIGHEST for action security_group_rules [ 988.035069] env[71140]: INFO networking_nsxv3.common.synchronization [req-6d24b103-323b-4cee-9dd3-f7a51bbf280c req-42111287-bf83-4cf4-b7c2-f18b6c6b11eb service nova] Enqueued Resource ID: f3b2c834-9214-45cf-a32f-db5f411105f6 with Priority: HIGHEST for action security_group_members [ 988.035233] env[71140]: INFO networking_nsxv3.common.synchronization [req-6d24b103-323b-4cee-9dd3-f7a51bbf280c req-42111287-bf83-4cf4-b7c2-f18b6c6b11eb service nova] Enqueued Resource ID: d1c9d542-28b0-4743-bb8a-af20ecf99f3e with Priority: HIGHEST for action port [ 988.035799] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b2c834-9214-45cf-a32f-db5f411105f6 with Priority: HIGHEST for action security_group_rules [ 988.035944] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b2c834-9214-45cf-a32f-db5f411105f6 with Priority: HIGHEST for action security_group_members [ 988.037568] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1c9d542-28b0-4743-bb8a-af20ecf99f3e with Priority: HIGHEST for action port [ 988.037898] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3b2c834-9214-45cf-a32f-db5f411105f6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.038052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.038131] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.038326] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.038408] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3b2c834-9214-45cf-a32f-db5f411105f6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.039662] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b2c834-9214-45cf-a32f-db5f411105f6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.039777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.039847] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.040037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.040189] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.040286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.040349] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.040553] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.040585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.040663] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b2c834-9214-45cf-a32f-db5f411105f6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.041420] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1c9d542-28b0-4743-bb8a-af20ecf99f3e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.041534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1c9d542-28b0-4743-bb8a-af20ecf99f3e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.041596] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1c9d542-28b0-4743-bb8a-af20ecf99f3e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.041749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1c9d542-28b0-4743-bb8a-af20ecf99f3e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.041826] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1c9d542-28b0-4743-bb8a-af20ecf99f3e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.543974] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b2c834-9214-45cf-a32f-db5f411105f6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.544306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.544485] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1c9d542-28b0-4743-bb8a-af20ecf99f3e with status ACTIVE [ 988.544686] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.544799] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.544876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.545161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.545268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.545460] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.545594] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.545649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.545800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.545877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.546118] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.546231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.546306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.546500] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.546593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.546680] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1c9d542-28b0-4743-bb8a-af20ecf99f3e is going to be updated. [ 988.547847] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3b2c834-9214-45cf-a32f-db5f411105f6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.566889] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.566889] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.566889] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.567115] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.567237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.567423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1c9d542-28b0-4743-bb8a-af20ecf99f3e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.050153] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3b2c834-9214-45cf-a32f-db5f411105f6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.552828] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.553223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.553223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.553394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.553501] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.553602] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b2c834-9214-45cf-a32f-db5f411105f6 is going to be created. [ 989.575127] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.575320] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.575393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.575595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.575753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.583948] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b2c834-9214-45cf-a32f-db5f411105f6 in Status: UNINITIALIZED for 2s [ 991.159620] env[71140]: INFO networking_nsxv3.common.synchronization [req-a3c72bac-c428-4724-95e6-0ff789976fd9 req-33848cfb-2c96-40f8-ac29-f8c03c451430 tempest-DeleteServersAdminTestJSON-1158134219 tempest-DeleteServersAdminTestJSON-1158134219-project-member] Enqueued Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGHEST for action security_group_members [ 991.160190] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGHEST for action security_group_members [ 991.160504] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.160641] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.160709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.160907] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.161073] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.161174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.161234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.161551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.161551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.161551] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.568962] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.569213] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.569385] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.569756] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.570240] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.570572] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.570747] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.571226] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.571494] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.572088] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 991.572088] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.572198] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.572410] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.572546] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 991.572766] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.573069] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 991.591927] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 991.592074] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 991.592223] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 991.592370] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.592918] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-6156dcb1-4c02-4b57-9e2e-c753da46e8a1 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.593155] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-6156dcb1-4c02-4b57-9e2e-c753da46e8a1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.594050] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-6156dcb1-4c02-4b57-9e2e-c753da46e8a1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.594050] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-6156dcb1-4c02-4b57-9e2e-c753da46e8a1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.594050] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6156dcb1-4c02-4b57-9e2e-c753da46e8a1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.595791] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b2c834-9214-45cf-a32f-db5f411105f6 in Status: SUCCESS [ 991.596453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.596453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.596619] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.596739] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.596850] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.596916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.597080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.597167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.597260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.597552] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3b2c834-9214-45cf-a32f-db5f411105f6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.665024] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.665180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.665180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.665461] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.665616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.665799] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.665924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.666015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.666222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.666342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.666434] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 is going to be updated. [ 991.694156] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.694314] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.694379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.694603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.694747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.704541] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 in Status: IN_PROGRESS for 2s [ 992.098180] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.098418] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.098558] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.098856] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.099014] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.099203] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 6156dcb1-4c02-4b57-9e2e-c753da46e8a1 not found, creating... [ 992.099711] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.099908] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.100057] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.100322] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.100573] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.101182] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.101435] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.101633] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.101856] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.102040] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.102228] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 6156dcb1-4c02-4b57-9e2e-c753da46e8a1 is going to be created. [ 992.103366] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3b2c834-9214-45cf-a32f-db5f411105f6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.121999] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.122222] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.122912] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.122912] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.122912] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.123072] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-6156dcb1-4c02-4b57-9e2e-c753da46e8a1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.605541] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3b2c834-9214-45cf-a32f-db5f411105f6: rpc.has_security_group_logging(os_id): False [ 992.622797] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.622991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.622991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.623213] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.623310] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.623555] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.623807] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.623807] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.623898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.623929] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.624021] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3b2c834-9214-45cf-a32f-db5f411105f6 is going to be created. [ 992.678354] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.678549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.678598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.678783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.678990] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.688913] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3b2c834-9214-45cf-a32f-db5f411105f6 in Status: IN_PROGRESS for 2s [ 992.948735] env[71140]: INFO networking_nsxv3.common.synchronization [req-a3c72bac-c428-4724-95e6-0ff789976fd9 req-911c8a16-1639-43ef-9df6-862422427723 service nova] Enqueued Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGHEST for action security_group_rules [ 992.948928] env[71140]: INFO networking_nsxv3.common.synchronization [req-a3c72bac-c428-4724-95e6-0ff789976fd9 req-911c8a16-1639-43ef-9df6-862422427723 service nova] Enqueued Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGHEST for action security_group_members [ 992.949087] env[71140]: INFO networking_nsxv3.common.synchronization [req-a3c72bac-c428-4724-95e6-0ff789976fd9 req-911c8a16-1639-43ef-9df6-862422427723 service nova] Enqueued Resource ID: 6156dcb1-4c02-4b57-9e2e-c753da46e8a1 with Priority: HIGHEST for action port [ 992.949327] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGHEST for action security_group_rules [ 992.949714] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGHEST for action security_group_members [ 992.949714] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6156dcb1-4c02-4b57-9e2e-c753da46e8a1 with Priority: HIGHEST for action port [ 992.950238] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a18e682e-ac56-4e1b-bb5d-a95392ee84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.950419] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.950512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.950733] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.950837] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.951742] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.951871] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.952098] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-6156dcb1-4c02-4b57-9e2e-c753da46e8a1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.954031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6156dcb1-4c02-4b57-9e2e-c753da46e8a1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.954031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6156dcb1-4c02-4b57-9e2e-c753da46e8a1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.954031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6156dcb1-4c02-4b57-9e2e-c753da46e8a1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.954031] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6156dcb1-4c02-4b57-9e2e-c753da46e8a1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.454426] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.454555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.454742] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6156dcb1-4c02-4b57-9e2e-c753da46e8a1 with status ACTIVE [ 993.454910] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.455050] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.455124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.455298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.455379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.455549] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.455642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.455698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.455849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.455926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.456123] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.456226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.456278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.456410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.456502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.456553] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6156dcb1-4c02-4b57-9e2e-c753da46e8a1 is going to be updated. [ 993.478392] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.478523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.478608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.478803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.478933] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.479098] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6156dcb1-4c02-4b57-9e2e-c753da46e8a1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.707930] env[71140]: INFO networking_nsxv3.common.synchronization [req-4de9739d-7b3c-41d0-84e4-2b7866c5851b req-3770cf46-0275-495e-97ac-9767813aea6d tempest-ServerActionsTestOtherA-289074452 tempest-ServerActionsTestOtherA-289074452-project-member] Enqueued Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_members [ 993.709052] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_members [ 993.709806] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-893ec538-5364-452f-9431-cbce81e1231d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.709937] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.710017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.710284] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.710447] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.710549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.710615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.710773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.710861] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.710957] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.716658] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 in Status: SUCCESS [ 993.716831] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 deletion is rescheduled due to dependency. [ 993.716935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.717467] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.717647] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.717805] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.717913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.717980] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.718142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.718253] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.718357] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.106210] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-53 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.106423] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.106552] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.106886] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.107205] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.107376] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.107498] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.107721] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.107868] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.108092] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.108232] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.108378] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.108523] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.108639] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.108747] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.108884] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.128111] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.128286] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 994.128423] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.128604] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.128939] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-7e5c3c70-2ac3-4df2-9e85-577ed326d26e taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.129125] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-7e5c3c70-2ac3-4df2-9e85-577ed326d26e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.129249] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-7e5c3c70-2ac3-4df2-9e85-577ed326d26e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.129632] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-7e5c3c70-2ac3-4df2-9e85-577ed326d26e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.129832] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e5c3c70-2ac3-4df2-9e85-577ed326d26e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.214074] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.214230] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.214303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.214580] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.214632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.214784] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.214880] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.214943] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.215105] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.215260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.215346] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 893ec538-5364-452f-9431-cbce81e1231d already deleted. [ 994.215474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.219788] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.635458] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.635458] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.635458] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.635458] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.635458] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.635458] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 7e5c3c70-2ac3-4df2-9e85-577ed326d26e not found, creating... [ 994.635458] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.635458] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.635458] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.635458] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.636154] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.636154] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.636154] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.636154] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.636154] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.636154] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.636348] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 7e5c3c70-2ac3-4df2-9e85-577ed326d26e is going to be created. [ 994.657492] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.657492] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.657492] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.657492] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.657905] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.657905] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-7e5c3c70-2ac3-4df2-9e85-577ed326d26e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.703057] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3b2c834-9214-45cf-a32f-db5f411105f6 in Status: SUCCESS [ 994.704082] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.721967] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.225949] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.227515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.228588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.229068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.229239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.230275] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 is going to be updated. [ 995.265529] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.265529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.265529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.265529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.265529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.273741] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 in Status: IN_PROGRESS for 2s [ 995.850377] env[71140]: INFO networking_nsxv3.common.synchronization [req-4de9739d-7b3c-41d0-84e4-2b7866c5851b req-e3b6cc05-e2e0-40d2-bd4d-69bfb4899a74 service nova] Enqueued Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_rules [ 995.850377] env[71140]: INFO networking_nsxv3.common.synchronization [req-4de9739d-7b3c-41d0-84e4-2b7866c5851b req-e3b6cc05-e2e0-40d2-bd4d-69bfb4899a74 service nova] Enqueued Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_members [ 995.850377] env[71140]: INFO networking_nsxv3.common.synchronization [req-4de9739d-7b3c-41d0-84e4-2b7866c5851b req-e3b6cc05-e2e0-40d2-bd4d-69bfb4899a74 service nova] Enqueued Resource ID: 7e5c3c70-2ac3-4df2-9e85-577ed326d26e with Priority: HIGHEST for action port [ 995.850377] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_rules [ 995.850377] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_members [ 995.850377] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5c3c70-2ac3-4df2-9e85-577ed326d26e with Priority: HIGHEST for action port [ 995.850377] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-893ec538-5364-452f-9431-cbce81e1231d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.850377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.850377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.851207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.851499] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.853481] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-893ec538-5364-452f-9431-cbce81e1231d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.853597] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.853664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.853848] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.854020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.854113] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.854181] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.855720] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.855816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.855914] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.859716] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e5c3c70-2ac3-4df2-9e85-577ed326d26e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.859716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e5c3c70-2ac3-4df2-9e85-577ed326d26e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.859716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e5c3c70-2ac3-4df2-9e85-577ed326d26e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.859716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e5c3c70-2ac3-4df2-9e85-577ed326d26e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.859716] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e5c3c70-2ac3-4df2-9e85-577ed326d26e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.360018] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-893ec538-5364-452f-9431-cbce81e1231d taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.360018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.360195] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.361323] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e5c3c70-2ac3-4df2-9e85-577ed326d26e with status ACTIVE [ 996.361323] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.361323] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.361531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.361668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.361668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.362046] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.362046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.362046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.362243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.362243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.362402] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.362491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.362591] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.362693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.362767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.362851] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e5c3c70-2ac3-4df2-9e85-577ed326d26e is going to be updated. [ 996.383140] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.383260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.383260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.383444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.383579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.383741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e5c3c70-2ac3-4df2-9e85-577ed326d26e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.867311] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.285753] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 in Status: SUCCESS [ 997.285753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.285753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.285753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.286025] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.286025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.286111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.286286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.286374] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.286466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.286567] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.368200] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.368423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.368498] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.368808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.368808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.368941] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 893ec538-5364-452f-9431-cbce81e1231d is going to be created. [ 997.393751] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.394018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.394018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.394696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.394696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.404319] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 893ec538-5364-452f-9431-cbce81e1231d in Status: UNINITIALIZED for 2s [ 997.789270] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.789270] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.789443] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.789572] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.789753] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.789863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.789958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.790095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.790188] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.790281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.790429] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.790521] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.790585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.790730] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.790872] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.790964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.791035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.791222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.791273] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.791355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.791450] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.294374] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a18e682e-ac56-4e1b-bb5d-a95392ee84c6: rpc.has_security_group_logging(os_id): False [ 998.310912] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.311079] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.311385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.311462] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.314874] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.316016] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.316016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.316016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.316016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.316016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.316016] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.316785] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.316886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.317047] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.317255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.318319] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.318319] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.318319] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.318319] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.318319] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.318319] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 is going to be updated. [ 998.364743] env[71140]: INFO networking_nsxv3.common.synchronization [req-bc630d76-13d2-4550-a73b-5a3aae58e805 req-a7937670-d8d3-47a3-8772-d426e5daab65 tempest-ImagesTestJSON-1376189349 tempest-ImagesTestJSON-1376189349-project-member] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 998.365336] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 998.365648] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.365770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.365850] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.366081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.366234] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.366347] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.366410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.366552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.366650] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.366744] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.375050] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.375238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.375332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.375512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.375703] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.389309] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 in Status: IN_PROGRESS for 2s [ 998.861625] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-920 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.861829] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.861968] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.862264] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.862535] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.862696] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.862819] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.865221] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.865438] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.865670] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.865795] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.865912] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.866226] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.866226] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.866373] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.866423] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 998.869442] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.869661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.869745] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.869924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.870025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.870204] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.870292] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.870353] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.870496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.870614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.870681] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be updated. [ 998.886492] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 998.886669] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 998.886816] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 998.887012] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-920" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.887419] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-b1925e72-0458-470c-8c9b-2f2a287fb18e taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.887626] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-b1925e72-0458-470c-8c9b-2f2a287fb18e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.887820] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-b1925e72-0458-470c-8c9b-2f2a287fb18e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.888077] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-b1925e72-0458-470c-8c9b-2f2a287fb18e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.888298] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1925e72-0458-470c-8c9b-2f2a287fb18e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.898212] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.898476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.898476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.898614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.899628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.908488] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 999.393517] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.393832] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.393902] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.394240] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.394402] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.394559] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port b1925e72-0458-470c-8c9b-2f2a287fb18e not found, creating... [ 999.394829] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.394998] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.395200] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.395751] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.395751] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.395999] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.396197] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.396323] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.396543] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.397068] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.397068] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: b1925e72-0458-470c-8c9b-2f2a287fb18e is going to be created. [ 999.414485] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 893ec538-5364-452f-9431-cbce81e1231d in Status: SUCCESS [ 999.414704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.414867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.415145] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.415382] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.415510] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.415577] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.415743] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.415827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.415914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.416022] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.419007] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.419219] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.419349] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.419600] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.419799] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.420035] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-b1925e72-0458-470c-8c9b-2f2a287fb18e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.869022] env[71140]: INFO networking_nsxv3.common.synchronization [None req-25b83b79-31de-4a6f-b6a1-0828bc940d5f None None] Enqueued Resource ID: 9dabb0b8-ec60-49e5-9608-7f279ff9af35 with Priority: HIGHEST for action port [ 999.869288] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dabb0b8-ec60-49e5-9608-7f279ff9af35 with Priority: HIGHEST for action port [ 999.869847] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dabb0b8-ec60-49e5-9608-7f279ff9af35 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.869960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dabb0b8-ec60-49e5-9608-7f279ff9af35" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.870043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dabb0b8-ec60-49e5-9608-7f279ff9af35" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.874205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dabb0b8-ec60-49e5-9608-7f279ff9af35" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.875230] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dabb0b8-ec60-49e5-9608-7f279ff9af35',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.919025] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.177561] env[71140]: INFO networking_nsxv3.common.synchronization [req-bc630d76-13d2-4550-a73b-5a3aae58e805 req-4ce1651d-35ef-4e08-82a0-34708ef55a96 service nova] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_rules [ 1000.177755] env[71140]: INFO networking_nsxv3.common.synchronization [req-bc630d76-13d2-4550-a73b-5a3aae58e805 req-4ce1651d-35ef-4e08-82a0-34708ef55a96 service nova] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 1000.177848] env[71140]: INFO networking_nsxv3.common.synchronization [req-bc630d76-13d2-4550-a73b-5a3aae58e805 req-4ce1651d-35ef-4e08-82a0-34708ef55a96 service nova] Enqueued Resource ID: b1925e72-0458-470c-8c9b-2f2a287fb18e with Priority: HIGHEST for action port [ 1000.178484] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_rules [ 1000.178532] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 1000.178611] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1925e72-0458-470c-8c9b-2f2a287fb18e with Priority: HIGHEST for action port [ 1000.178878] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.178999] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.183172] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.183403] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.183494] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.184353] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.184475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.184686] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1925e72-0458-470c-8c9b-2f2a287fb18e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.184786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1925e72-0458-470c-8c9b-2f2a287fb18e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.184842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1925e72-0458-470c-8c9b-2f2a287fb18e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.185026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1925e72-0458-470c-8c9b-2f2a287fb18e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.185349] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1925e72-0458-470c-8c9b-2f2a287fb18e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.381331] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9dabb0b8-ec60-49e5-9608-7f279ff9af35 [ 1000.381702] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.381702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.381865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.381976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.382095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.382196] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9dabb0b8-ec60-49e5-9608-7f279ff9af35 already deleted. [ 1000.382282] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dabb0b8-ec60-49e5-9608-7f279ff9af35" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.402323] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 in Status: SUCCESS [ 1000.402593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.422326] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 893ec538-5364-452f-9431-cbce81e1231d: rpc.has_security_group_logging(os_id): False [ 1000.438471] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.438628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.438668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.438903] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.441321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.441321] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.441321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.441321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.441321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.441321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.441321] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 893ec538-5364-452f-9431-cbce81e1231d is going to be created. [ 1000.497315] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.497563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.497662] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.497870] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.498300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.511047] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 893ec538-5364-452f-9431-cbce81e1231d in Status: IN_PROGRESS for 2s [ 1000.688671] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1925e72-0458-470c-8c9b-2f2a287fb18e with status ACTIVE [ 1000.689817] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.689817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.689817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.689817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.689817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.689817] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.689817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.690109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.690109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.690165] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.690315] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.691128] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.691128] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.691128] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.691128] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.691128] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1925e72-0458-470c-8c9b-2f2a287fb18e is going to be updated. [ 1000.692957] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.693168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.713300] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.713520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.713638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.713876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.714571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.714571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1925e72-0458-470c-8c9b-2f2a287fb18e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.921042] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 1000.921042] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 deletion is rescheduled due to dependency. [ 1000.921042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.921223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.921404] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.922526] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.922526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.922526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.922526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.922526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.922526] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.425428] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.930639] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.303210] env[71140]: INFO networking_nsxv3.common.synchronization [None req-2cec1c89-2571-4b89-8314-33599b5a1948 None None] Enqueued Resource ID: 8aa38d94-8609-4e03-9431-a7d916fb4496 with Priority: HIGHEST for action port [ 1002.303210] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8aa38d94-8609-4e03-9431-a7d916fb4496 with Priority: HIGHEST for action port [ 1002.303210] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-8aa38d94-8609-4e03-9431-a7d916fb4496 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.303210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8aa38d94-8609-4e03-9431-a7d916fb4496" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.303210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8aa38d94-8609-4e03-9431-a7d916fb4496" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.303210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8aa38d94-8609-4e03-9431-a7d916fb4496" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.303210] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8aa38d94-8609-4e03-9431-a7d916fb4496',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.433635] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.433976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.433976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.434822] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.434935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.435062] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be updated. [ 1002.462285] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.462476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.462534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.462728] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.462877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.470628] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 1002.523756] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 893ec538-5364-452f-9431-cbce81e1231d in Status: SUCCESS [ 1002.523999] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.807475] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8aa38d94-8609-4e03-9431-a7d916fb4496 [ 1002.807475] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.807662] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.807662] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.807899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.807988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.808098] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8aa38d94-8609-4e03-9431-a7d916fb4496 already deleted. [ 1002.808186] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8aa38d94-8609-4e03-9431-a7d916fb4496" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.290602] env[71140]: INFO networking_nsxv3.common.synchronization [req-eb7fc8fb-2e43-43b7-8138-62ddca6de83f req-8b64bdba-ce26-4f7b-9b36-5abe57769a86 tempest-DeleteServersAdminTestJSON-1158134219 tempest-DeleteServersAdminTestJSON-1158134219-project-member] Enqueued Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGHEST for action security_group_members [ 1004.291142] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGHEST for action security_group_members [ 1004.291504] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.291625] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.291697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.291889] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.292299] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.292400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.292400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.292534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.292615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.292721] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.481382] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 1004.481618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.481794] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.482075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.482219] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.482339] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.482402] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.482559] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.482642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.482730] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.482822] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.795425] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.795595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.795643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.795859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.795955] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.796160] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.796269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.796376] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.796541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.796623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.796713] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 is going to be updated. [ 1004.822418] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.822611] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.822808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.822943] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.823137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.831450] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 in Status: IN_PROGRESS for 2s [ 1004.985575] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.985743] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.985817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.986066] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.986246] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.986416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.986574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.986988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.986988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.986988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.987302] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.987459] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.987546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.987759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.987891] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.988045] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.988269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.988487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.988608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.988724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.988984] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.492138] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43a772d0-e00d-4627-ad2d-c6c3ccbcee06: rpc.has_security_group_logging(os_id): False [ 1005.510418] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.510705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.510705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.510852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.510948] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.511165] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.511267] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.511330] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.511483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.511562] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.511748] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.511842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.511905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.512058] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.512142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.512341] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.512438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.512492] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.512639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.512722] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.512790] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be updated. [ 1005.574644] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.574934] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.575354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.575736] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.576026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.602080] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 1005.701635] env[71140]: INFO networking_nsxv3.common.synchronization [req-423e9f4f-c7bc-4c37-82e0-0beb7e582f65 req-fee181ba-ddbc-421c-9271-14c23c09d88d tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a with Priority: HIGHEST for action security_group_members [ 1005.701635] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a with Priority: HIGHEST for action security_group_members [ 1005.705024] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-66227fe8-4a5f-47ba-add3-defc26d5bd6a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.705024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.705024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.705024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.705024] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.705024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.705024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.705024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.705024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.705024] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66227fe8-4a5f-47ba-add3-defc26d5bd6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.081690] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-941 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.081690] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.081870] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.082066] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.082329] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.082490] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.082642] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.082942] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.083349] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.083583] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.083704] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.083817] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.083981] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.084056] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.084154] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.084291] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.100982] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.100982] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1006.101152] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.101291] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.101604] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-f3025694-e41d-49cb-b275-61a103fa03b8 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.101772] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-f3025694-e41d-49cb-b275-61a103fa03b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.101896] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-f3025694-e41d-49cb-b275-61a103fa03b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.102239] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-f3025694-e41d-49cb-b275-61a103fa03b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.102388] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3025694-e41d-49cb-b275-61a103fa03b8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.211644] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.212184] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.212184] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.212184] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.212184] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.212435] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.212509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.212618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.212842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.212951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.213092] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a already deleted. [ 1006.213228] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.604558] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.604848] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.604945] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.605278] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.605430] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.605590] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port f3025694-e41d-49cb-b275-61a103fa03b8 not found, creating... [ 1006.605858] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.606022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.606185] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.606422] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.606565] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.606850] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.607016] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.607201] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.607413] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.607619] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.607696] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: f3025694-e41d-49cb-b275-61a103fa03b8 is going to be created. [ 1006.626519] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.626607] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.626721] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.627018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.627285] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.627530] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-f3025694-e41d-49cb-b275-61a103fa03b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.841862] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 in Status: SUCCESS [ 1006.842095] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 deletion is rescheduled due to dependency. [ 1006.842194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.420304] env[71140]: INFO networking_nsxv3.common.synchronization [req-423e9f4f-c7bc-4c37-82e0-0beb7e582f65 req-57712346-6254-4574-8dda-b83b3034983a service nova] Enqueued Resource ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a with Priority: HIGHEST for action security_group_rules [ 1007.420304] env[71140]: INFO networking_nsxv3.common.synchronization [req-423e9f4f-c7bc-4c37-82e0-0beb7e582f65 req-57712346-6254-4574-8dda-b83b3034983a service nova] Enqueued Resource ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a with Priority: HIGHEST for action security_group_members [ 1007.420304] env[71140]: INFO networking_nsxv3.common.synchronization [req-423e9f4f-c7bc-4c37-82e0-0beb7e582f65 req-57712346-6254-4574-8dda-b83b3034983a service nova] Enqueued Resource ID: f3025694-e41d-49cb-b275-61a103fa03b8 with Priority: HIGHEST for action port [ 1007.420304] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a with Priority: HIGHEST for action security_group_rules [ 1007.420773] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a with Priority: HIGHEST for action security_group_members [ 1007.421152] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3025694-e41d-49cb-b275-61a103fa03b8 with Priority: HIGHEST for action port [ 1007.423961] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66227fe8-4a5f-47ba-add3-defc26d5bd6a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.423961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.423961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.423961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.423961] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66227fe8-4a5f-47ba-add3-defc26d5bd6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.423961] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-66227fe8-4a5f-47ba-add3-defc26d5bd6a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.423961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.423961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.423961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.423961] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.423961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.424496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.424606] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.424744] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.424863] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66227fe8-4a5f-47ba-add3-defc26d5bd6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.425834] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3025694-e41d-49cb-b275-61a103fa03b8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.425959] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3025694-e41d-49cb-b275-61a103fa03b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.426038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3025694-e41d-49cb-b275-61a103fa03b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.426240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3025694-e41d-49cb-b275-61a103fa03b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.426412] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3025694-e41d-49cb-b275-61a103fa03b8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.619848] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 1007.620199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.928552] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-66227fe8-4a5f-47ba-add3-defc26d5bd6a taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.928695] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.928854] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66227fe8-4a5f-47ba-add3-defc26d5bd6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.929783] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3025694-e41d-49cb-b275-61a103fa03b8 with status ACTIVE [ 1007.929976] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.930103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.930168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.930373] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.930474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.930676] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.930779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.930840] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.931017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.931099] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.931278] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.931371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.931430] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.931568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.931640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.931723] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3025694-e41d-49cb-b275-61a103fa03b8 is going to be updated. [ 1007.951993] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.952201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.952289] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.952501] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.952638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.952803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3025694-e41d-49cb-b275-61a103fa03b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.433591] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66227fe8-4a5f-47ba-add3-defc26d5bd6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.936260] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.936601] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.936601] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.936789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.936789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.936888] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a is going to be created. [ 1008.960090] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.960242] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.960308] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.960519] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.960694] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.970361] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a in Status: UNINITIALIZED for 2s [ 1010.980390] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a in Status: SUCCESS [ 1010.980672] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.980769] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.981137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.981236] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.981327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.981394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.981556] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.981644] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.981731] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.981858] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66227fe8-4a5f-47ba-add3-defc26d5bd6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.054013] env[71140]: INFO networking_nsxv3.common.synchronization [req-6ef9ed71-ad9b-4f27-867e-be8864c15469 req-d2046d6d-c4f1-42ba-8f51-8860a1f2df4c tempest-ListImageFiltersTestJSON-1329577525 tempest-ListImageFiltersTestJSON-1329577525-project-member] Enqueued Resource ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 with Priority: HIGHEST for action security_group_members [ 1011.054563] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 with Priority: HIGHEST for action security_group_members [ 1011.054887] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2548cfa1-8571-4be8-becb-2b5d950d7202 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.055025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.055100] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.055348] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.055514] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.055631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.055692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.055855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.055939] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.056045] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.484855] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66227fe8-4a5f-47ba-add3-defc26d5bd6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.560622] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.560831] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.560874] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.561207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.561351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.561583] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.561731] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.561808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.561996] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.562154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.562276] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 already deleted. [ 1011.562409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.747478] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.747667] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.747976] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.748070] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.748340] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.748550] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.748608] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.750115] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.750325] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.750639] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1011.750716] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.750904] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.751082] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.751230] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1011.751358] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.751517] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.770856] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.771119] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1011.771291] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.771639] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.771824] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-bdf0269d-3d2c-4e21-a70b-92d48995ccf3 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.772051] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-bdf0269d-3d2c-4e21-a70b-92d48995ccf3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.772219] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-bdf0269d-3d2c-4e21-a70b-92d48995ccf3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.772613] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-bdf0269d-3d2c-4e21-a70b-92d48995ccf3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.772794] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdf0269d-3d2c-4e21-a70b-92d48995ccf3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.995646] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66227fe8-4a5f-47ba-add3-defc26d5bd6a: rpc.has_security_group_logging(os_id): False [ 1012.015083] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.015083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.015083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.015083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.015083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.015083] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.015083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.015083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.015083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.015083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.015083] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a is going to be created. [ 1012.072184] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.072184] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.072184] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.072184] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.072184] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.080996] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a in Status: IN_PROGRESS for 2s [ 1012.276803] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.276974] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.277079] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.277477] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.277641] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.277803] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port bdf0269d-3d2c-4e21-a70b-92d48995ccf3 not found, creating... [ 1012.278117] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.278334] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.278468] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.278712] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.278862] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.279170] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.279334] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.279457] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.279668] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.279807] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.279951] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: bdf0269d-3d2c-4e21-a70b-92d48995ccf3 is going to be created. [ 1012.300557] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.300753] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.300885] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.301201] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.301433] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.301658] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-bdf0269d-3d2c-4e21-a70b-92d48995ccf3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.137926] env[71140]: INFO networking_nsxv3.common.synchronization [req-6ef9ed71-ad9b-4f27-867e-be8864c15469 req-6d3d2825-a450-47ff-b557-2274805fe127 service nova] Enqueued Resource ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 with Priority: HIGHEST for action security_group_rules [ 1013.141099] env[71140]: INFO networking_nsxv3.common.synchronization [req-6ef9ed71-ad9b-4f27-867e-be8864c15469 req-6d3d2825-a450-47ff-b557-2274805fe127 service nova] Enqueued Resource ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 with Priority: HIGHEST for action security_group_members [ 1013.141099] env[71140]: INFO networking_nsxv3.common.synchronization [req-6ef9ed71-ad9b-4f27-867e-be8864c15469 req-6d3d2825-a450-47ff-b557-2274805fe127 service nova] Enqueued Resource ID: bdf0269d-3d2c-4e21-a70b-92d48995ccf3 with Priority: HIGHEST for action port [ 1013.141099] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 with Priority: HIGHEST for action security_group_rules [ 1013.141099] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 with Priority: HIGHEST for action security_group_members [ 1013.141099] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdf0269d-3d2c-4e21-a70b-92d48995ccf3 with Priority: HIGHEST for action port [ 1013.141099] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2548cfa1-8571-4be8-becb-2b5d950d7202 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.141099] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.141099] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.141099] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.141099] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.142110] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2548cfa1-8571-4be8-becb-2b5d950d7202 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.142269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.142360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.142800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.142990] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.143159] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.143236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.145210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.145210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.145210] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.145210] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdf0269d-3d2c-4e21-a70b-92d48995ccf3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.145210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdf0269d-3d2c-4e21-a70b-92d48995ccf3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.145210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdf0269d-3d2c-4e21-a70b-92d48995ccf3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.145210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdf0269d-3d2c-4e21-a70b-92d48995ccf3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.145747] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdf0269d-3d2c-4e21-a70b-92d48995ccf3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.479911] env[71140]: INFO networking_nsxv3.common.synchronization [req-34a01504-eef2-4ab2-b02e-6ec4d8d1b6fd req-878242fa-8c34-4c39-999e-7ba00128a43c tempest-ListImageFiltersTestJSON-1329577525 tempest-ListImageFiltersTestJSON-1329577525-project-member] Enqueued Resource ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 with Priority: HIGHEST for action security_group_members [ 1013.480525] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 with Priority: HIGHEST for action security_group_members [ 1013.480889] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2548cfa1-8571-4be8-becb-2b5d950d7202 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.481021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.642823] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2548cfa1-8571-4be8-becb-2b5d950d7202 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.643064] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.647512] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.648513] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bdf0269d-3d2c-4e21-a70b-92d48995ccf3 with status ACTIVE [ 1013.650911] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.652094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.652094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.652094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.652094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.652094] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.652094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.652094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.652094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.652094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.656575] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.656575] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.656575] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.656575] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.656575] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.656575] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bdf0269d-3d2c-4e21-a70b-92d48995ccf3 is going to be updated. [ 1013.682590] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.682750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.682820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.683059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.683319] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.683385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdf0269d-3d2c-4e21-a70b-92d48995ccf3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.987931] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.988155] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.988303] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.988586] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.988869] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.989013] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.989151] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.989398] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.989555] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.989787] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.989906] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.990030] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.990145] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.990257] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.990372] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.990505] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.009634] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1014.009801] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1014.009984] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1014.010206] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.010570] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-cf59131a-8794-4c17-ad2b-4caf4999695b taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.010774] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-cf59131a-8794-4c17-ad2b-4caf4999695b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.010927] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-cf59131a-8794-4c17-ad2b-4caf4999695b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.011400] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-cf59131a-8794-4c17-ad2b-4caf4999695b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.011616] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf59131a-8794-4c17-ad2b-4caf4999695b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.092809] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a in Status: SUCCESS [ 1014.093097] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.154941] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.519896] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.520152] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.520291] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.520608] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.520783] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.520948] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port cf59131a-8794-4c17-ad2b-4caf4999695b not found, creating... [ 1014.521227] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.521390] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.521515] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.521833] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.521981] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.522300] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.522485] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.522610] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.522830] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.522970] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.523129] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: cf59131a-8794-4c17-ad2b-4caf4999695b is going to be created. [ 1014.543677] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.543879] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.543942] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.544233] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.544460] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.544703] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-cf59131a-8794-4c17-ad2b-4caf4999695b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.661459] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.661608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.661655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.661865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.661972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.662064] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 is going to be created. [ 1014.689214] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.689356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.689423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.689649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.689798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.705466] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 in Status: UNINITIALIZED for 2s [ 1014.972417] env[71140]: INFO networking_nsxv3.common.synchronization [req-ab421b18-2667-4f90-b02a-a54f2f947b9b req-9632014d-a1f3-43bf-844a-04c9d08ad4e5 tempest-AttachVolumeNegativeTest-950002537 tempest-AttachVolumeNegativeTest-950002537-project-member] Enqueued Resource ID: 6f6ea965-586b-4847-a20f-3619378cb260 with Priority: HIGHEST for action security_group_members [ 1014.974035] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6ea965-586b-4847-a20f-3619378cb260 with Priority: HIGHEST for action security_group_members [ 1014.974035] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6ea965-586b-4847-a20f-3619378cb260 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.974035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.974035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.974773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.976815] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.976815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.976815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.976815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.976815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.976815] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f6ea965-586b-4847-a20f-3619378cb260',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.482817] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.483255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.483255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.483368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.505040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.505345] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.505489] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.505564] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.505770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.505859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.505952] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f6ea965-586b-4847-a20f-3619378cb260 is going to be updated. [ 1015.532019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.532019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.532019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.532019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.532019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.539524] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6ea965-586b-4847-a20f-3619378cb260 in Status: IN_PROGRESS for 2s [ 1015.791179] env[71140]: INFO networking_nsxv3.common.synchronization [req-34a01504-eef2-4ab2-b02e-6ec4d8d1b6fd req-a72862c4-291d-4da8-a407-9d2b61662419 service nova] Enqueued Resource ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 with Priority: HIGHEST for action security_group_rules [ 1015.791179] env[71140]: INFO networking_nsxv3.common.synchronization [req-34a01504-eef2-4ab2-b02e-6ec4d8d1b6fd req-a72862c4-291d-4da8-a407-9d2b61662419 service nova] Enqueued Resource ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 with Priority: HIGHEST for action security_group_members [ 1015.791264] env[71140]: INFO networking_nsxv3.common.synchronization [req-34a01504-eef2-4ab2-b02e-6ec4d8d1b6fd req-a72862c4-291d-4da8-a407-9d2b61662419 service nova] Enqueued Resource ID: cf59131a-8794-4c17-ad2b-4caf4999695b with Priority: HIGHEST for action port [ 1015.791454] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 with Priority: HIGHEST for action security_group_rules [ 1015.791572] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 with Priority: HIGHEST for action security_group_members [ 1015.791713] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf59131a-8794-4c17-ad2b-4caf4999695b with Priority: HIGHEST for action port [ 1015.792220] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2548cfa1-8571-4be8-becb-2b5d950d7202 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.792321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.792508] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2548cfa1-8571-4be8-becb-2b5d950d7202 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.792591] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.792755] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf59131a-8794-4c17-ad2b-4caf4999695b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.792851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf59131a-8794-4c17-ad2b-4caf4999695b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.792915] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf59131a-8794-4c17-ad2b-4caf4999695b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.793162] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf59131a-8794-4c17-ad2b-4caf4999695b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.793198] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf59131a-8794-4c17-ad2b-4caf4999695b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.295406] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf59131a-8794-4c17-ad2b-4caf4999695b with status ACTIVE [ 1016.295627] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.295771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.295833] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.296091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.296188] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.296384] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.296518] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.296585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.296742] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.296820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.297083] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.297156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.297296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.297370] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.297448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.297566] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf59131a-8794-4c17-ad2b-4caf4999695b is going to be updated. [ 1016.317790] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.317957] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.317957] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.318210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.318395] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.318584] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf59131a-8794-4c17-ad2b-4caf4999695b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.714064] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 in Status: SUCCESS [ 1016.714334] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.714603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.714702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.714889] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.715037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.715183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.715263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.715345] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.715460] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.999385] env[71140]: INFO networking_nsxv3.common.synchronization [req-d23742b3-a38b-4bb0-aed0-57b2b1fc8c3c req-277f19f3-6c6e-4cfe-b844-b7c5d8da0c34 tempest-AttachVolumeTestJSON-775620922 tempest-AttachVolumeTestJSON-775620922-project-member] Enqueued Resource ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 with Priority: HIGHEST for action security_group_members [ 1016.999652] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 with Priority: HIGHEST for action security_group_members [ 1016.999979] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9372f7d-fcc5-4703-b77d-bbb4d1695328 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.000120] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.000188] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.000446] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.000606] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.000704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.000766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.000918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.001009] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.001120] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9372f7d-fcc5-4703-b77d-bbb4d1695328',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.217890] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.353366] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-990 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.353835] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-990" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.353835] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-990" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.354278] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-990" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.354612] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.354961] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.354961] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.355308] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.355902] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.355902] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1017.355902] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1017.356095] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1017.356168] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1017.356279] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1017.356446] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1017.356640] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1017.375418] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1017.375604] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1017.375808] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1017.375920] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-990" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.376375] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-065a397a-c6b6-4e8f-8653-a93ad809b45d taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.376453] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-065a397a-c6b6-4e8f-8653-a93ad809b45d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.376536] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-065a397a-c6b6-4e8f-8653-a93ad809b45d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.376932] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-065a397a-c6b6-4e8f-8653-a93ad809b45d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.377159] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('065a397a-c6b6-4e8f-8653-a93ad809b45d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.503601] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.504011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.504134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.504475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.504595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.504820] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.504927] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.504996] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.505244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.505323] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.505418] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 already deleted. [ 1017.505498] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.548971] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6ea965-586b-4847-a20f-3619378cb260 in Status: SUCCESS [ 1017.549195] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f6ea965-586b-4847-a20f-3619378cb260 deletion is rescheduled due to dependency. [ 1017.549266] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.720616] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.879868] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.880055] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.880193] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.880523] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.880649] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.880810] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 065a397a-c6b6-4e8f-8653-a93ad809b45d not found, creating... [ 1017.881087] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.881249] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.881375] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.881600] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.881752] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.882030] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.882334] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.882334] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.882546] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.882711] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.882862] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 065a397a-c6b6-4e8f-8653-a93ad809b45d is going to be created. [ 1017.901301] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.901500] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.901632] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.901898] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.902147] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.902431] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-065a397a-c6b6-4e8f-8653-a93ad809b45d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.223041] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.223233] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.223319] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.223538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.223633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.223734] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 is going to be updated. [ 1018.252253] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.252406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.252469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.252674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.252817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.260940] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 in Status: IN_PROGRESS for 2s [ 1018.587532] env[71140]: INFO networking_nsxv3.common.synchronization [req-d23742b3-a38b-4bb0-aed0-57b2b1fc8c3c req-2c403d90-5d00-470a-a286-c81657f6a786 service nova] Enqueued Resource ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 with Priority: HIGHEST for action security_group_rules [ 1018.587748] env[71140]: INFO networking_nsxv3.common.synchronization [req-d23742b3-a38b-4bb0-aed0-57b2b1fc8c3c req-2c403d90-5d00-470a-a286-c81657f6a786 service nova] Enqueued Resource ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 with Priority: HIGHEST for action security_group_members [ 1018.587925] env[71140]: INFO networking_nsxv3.common.synchronization [req-d23742b3-a38b-4bb0-aed0-57b2b1fc8c3c req-2c403d90-5d00-470a-a286-c81657f6a786 service nova] Enqueued Resource ID: 065a397a-c6b6-4e8f-8653-a93ad809b45d with Priority: HIGHEST for action port [ 1018.588555] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 with Priority: HIGHEST for action security_group_rules [ 1018.588732] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 with Priority: HIGHEST for action security_group_members [ 1018.588915] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 065a397a-c6b6-4e8f-8653-a93ad809b45d with Priority: HIGHEST for action port [ 1018.591260] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.591433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.591472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.591694] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.591771] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9372f7d-fcc5-4703-b77d-bbb4d1695328',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.592867] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9372f7d-fcc5-4703-b77d-bbb4d1695328 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.593013] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.593086] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.593280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.593436] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.593528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.593604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.593728] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.593807] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.593903] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9372f7d-fcc5-4703-b77d-bbb4d1695328',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.595267] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-065a397a-c6b6-4e8f-8653-a93ad809b45d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.595425] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-065a397a-c6b6-4e8f-8653-a93ad809b45d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.595495] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-065a397a-c6b6-4e8f-8653-a93ad809b45d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.595660] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-065a397a-c6b6-4e8f-8653-a93ad809b45d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.595735] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('065a397a-c6b6-4e8f-8653-a93ad809b45d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.097624] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9372f7d-fcc5-4703-b77d-bbb4d1695328',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.098977] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9372f7d-fcc5-4703-b77d-bbb4d1695328 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.099117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.103290] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 065a397a-c6b6-4e8f-8653-a93ad809b45d with status ACTIVE [ 1019.103290] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.103290] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.103290] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.104314] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.104440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.104748] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.104926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.105261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.105481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.105481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.105811] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.109143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.109143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.109143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.109143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.109143] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 065a397a-c6b6-4e8f-8653-a93ad809b45d is going to be updated. [ 1019.133652] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.133840] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.133920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.134238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.134409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.134584] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-065a397a-c6b6-4e8f-8653-a93ad809b45d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.602366] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9372f7d-fcc5-4703-b77d-bbb4d1695328',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.104811] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.105318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.105318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.105318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.105514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.105565] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 is going to be created. [ 1020.136892] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.136892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.136892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.137109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.137161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.147782] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 in Status: UNINITIALIZED for 2s [ 1020.269809] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 in Status: SUCCESS [ 1020.270119] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.270325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.270585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.270788] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.270909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.270975] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.271155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.271240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.271328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.271426] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.272784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.273118] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.273293] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.273401] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.273467] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.273615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.273701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.273794] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.773750] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2548cfa1-8571-4be8-becb-2b5d950d7202 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.773891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.775221] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.278072] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.341184] env[71140]: INFO networking_nsxv3.common.synchronization [req-591668f4-7039-449e-8afa-c48cc5a5f5e1 req-3660312d-9f40-44a5-8674-e656065be9eb tempest-MultipleCreateTestJSON-727311014 tempest-MultipleCreateTestJSON-727311014-project-member] Enqueued Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 1021.341998] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 1021.342405] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.342543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.342613] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.342813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.342967] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.343091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.343159] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.343307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.343392] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.343487] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.628383] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-855 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.628794] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-855" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.628794] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-855" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.628984] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-855" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.629255] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.629468] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.629599] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.629816] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.630028] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.630190] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1021.630306] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.630423] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.630596] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.630653] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1021.630896] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.630896] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.659682] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.662197] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1021.662424] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.664109] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-855" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.664109] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-68f42adb-f649-42e3-9f5e-51a2bad496b1 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.664109] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-68f42adb-f649-42e3-9f5e-51a2bad496b1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.664109] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-68f42adb-f649-42e3-9f5e-51a2bad496b1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.664109] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-68f42adb-f649-42e3-9f5e-51a2bad496b1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.665512] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68f42adb-f649-42e3-9f5e-51a2bad496b1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.739638] env[71140]: INFO networking_nsxv3.common.synchronization [req-e2de6d5e-0db9-44f5-95c8-9d0373468a93 req-1ad9e6a6-3671-4342-a676-99ec8059f87d tempest-ImagesTestJSON-1376189349 tempest-ImagesTestJSON-1376189349-project-member] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 1021.740462] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGHEST for action security_group_members [ 1021.740629] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.740813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.740875] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.741081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.741202] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.741311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.741365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.741706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.741706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.741706] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.780157] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.781095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.781194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.781413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.781515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.781622] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 is going to be updated. [ 1021.826028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.826028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.826028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.826028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.826028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.841011] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 in Status: IN_PROGRESS for 2s [ 1021.845542] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.845690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.845765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.845970] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.846080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.846268] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.846367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.846430] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.846666] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.846806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.846925] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 is going to be updated. [ 1021.875537] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.875537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.875537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.875537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.875537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.881588] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: IN_PROGRESS for 2s [ 1022.156951] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 in Status: SUCCESS [ 1022.157262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.157492] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.157708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.157894] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.158021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.158082] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.158237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.158320] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.158399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.158494] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9372f7d-fcc5-4703-b77d-bbb4d1695328',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.171543] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.171826] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.171964] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.172231] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.172381] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.172535] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 68f42adb-f649-42e3-9f5e-51a2bad496b1 not found, creating... [ 1022.172805] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.172963] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.173096] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.173353] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.173509] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.173862] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.173959] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.174071] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.174282] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.174420] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.174561] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 68f42adb-f649-42e3-9f5e-51a2bad496b1 is going to be created. [ 1022.204533] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.204733] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.204861] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.205308] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.205414] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.205712] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-68f42adb-f649-42e3-9f5e-51a2bad496b1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.246193] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.246320] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.246320] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.246519] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.246611] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.246800] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.246897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.246960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.247149] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.247245] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.247388] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be updated. [ 1022.275330] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.275330] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.275330] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.275553] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.275718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.284758] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: IN_PROGRESS for 2s [ 1022.661480] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9372f7d-fcc5-4703-b77d-bbb4d1695328',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.980279] env[71140]: INFO networking_nsxv3.common.synchronization [req-591668f4-7039-449e-8afa-c48cc5a5f5e1 req-a96cc9ba-8c8e-447c-a404-a7394fb54c21 service nova] Enqueued Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_rules [ 1022.980462] env[71140]: INFO networking_nsxv3.common.synchronization [req-591668f4-7039-449e-8afa-c48cc5a5f5e1 req-a96cc9ba-8c8e-447c-a404-a7394fb54c21 service nova] Enqueued Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 1022.980611] env[71140]: INFO networking_nsxv3.common.synchronization [req-591668f4-7039-449e-8afa-c48cc5a5f5e1 req-a96cc9ba-8c8e-447c-a404-a7394fb54c21 service nova] Enqueued Resource ID: 68f42adb-f649-42e3-9f5e-51a2bad496b1 with Priority: HIGHEST for action port [ 1022.980839] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_rules [ 1022.980964] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 1022.981072] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68f42adb-f649-42e3-9f5e-51a2bad496b1 with Priority: HIGHEST for action port [ 1022.982110] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.982110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.982110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.982110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.982110] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.983080] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.983182] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.983397] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-68f42adb-f649-42e3-9f5e-51a2bad496b1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.983593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68f42adb-f649-42e3-9f5e-51a2bad496b1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.983593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68f42adb-f649-42e3-9f5e-51a2bad496b1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.983728] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68f42adb-f649-42e3-9f5e-51a2bad496b1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.983814] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68f42adb-f649-42e3-9f5e-51a2bad496b1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.163416] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9372f7d-fcc5-4703-b77d-bbb4d1695328: rpc.has_security_group_logging(os_id): False [ 1023.180135] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.180284] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.180361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.180566] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.180662] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.180906] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.181028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.181077] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.181231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.181309] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.181398] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 is going to be created. [ 1023.250768] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.250925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.250998] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.251239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.251421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.268689] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 in Status: IN_PROGRESS for 2s [ 1023.485962] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.487931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.487931] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68f42adb-f649-42e3-9f5e-51a2bad496b1 with status ACTIVE [ 1023.487931] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.487931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.487931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.488237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.488237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.488435] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.488528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.488612] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.488783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.488867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.489096] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.489199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.489263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.489492] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.489630] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.489741] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68f42adb-f649-42e3-9f5e-51a2bad496b1 is going to be updated. [ 1023.509290] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.509431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.509529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.509754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.509892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.510084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68f42adb-f649-42e3-9f5e-51a2bad496b1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.838272] env[71140]: INFO networking_nsxv3.common.synchronization [req-591668f4-7039-449e-8afa-c48cc5a5f5e1 req-d1b0980e-e55a-420f-af4f-898a27d9995c tempest-MultipleCreateTestJSON-727311014 tempest-MultipleCreateTestJSON-727311014-project-member] Enqueued Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 1023.838885] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 1023.839210] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.839315] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.850183] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 in Status: SUCCESS [ 1023.850183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.850183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.850183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.850183] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.850381] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.850381] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.850754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.850754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.850754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.850966] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2548cfa1-8571-4be8-becb-2b5d950d7202 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.850966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.850966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.851145] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.851224] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.851315] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.851384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.851508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.851578] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.851660] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.851747] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.889118] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: SUCCESS [ 1023.889400] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 deletion is rescheduled due to dependency. [ 1023.889400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.889577] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.889814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.889963] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.890089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.890198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.890310] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.890418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.890562] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.126975] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-855 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.127328] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-855" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.127488] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-855" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.127950] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-855" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.128374] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.129031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.129031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.129031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.129191] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.129762] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1024.129762] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.129762] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.129762] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.129933] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1024.129966] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.130382] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.147153] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.147400] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1024.147561] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.147794] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-855" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.148135] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-14c4bdb4-a63c-44da-8e31-cd8bd42ea288 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.148319] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-14c4bdb4-a63c-44da-8e31-cd8bd42ea288" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.148447] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-14c4bdb4-a63c-44da-8e31-cd8bd42ea288" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.148770] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-14c4bdb4-a63c-44da-8e31-cd8bd42ea288" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.148956] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14c4bdb4-a63c-44da-8e31-cd8bd42ea288',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.294500] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 in Status: SUCCESS [ 1024.294689] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 deletion is rescheduled due to dependency. [ 1024.294808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.353417] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2548cfa1-8571-4be8-becb-2b5d950d7202: rpc.has_security_group_logging(os_id): False [ 1024.370404] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.370497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.370622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.370836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.370869] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.371088] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.371191] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.371249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.371410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.371485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.371669] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.371762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.371817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.371957] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.372054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.372271] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.372319] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.372386] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.372533] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.372747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.372835] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 is going to be created. [ 1024.392776] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.427047] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.427225] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.427319] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.427570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.427786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.437871] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 in Status: IN_PROGRESS for 2s [ 1024.651670] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.652122] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.652210] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.652589] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.652763] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.652932] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 14c4bdb4-a63c-44da-8e31-cd8bd42ea288 not found, creating... [ 1024.653302] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.653541] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.654839] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.654839] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.654839] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.654839] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.654839] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.655347] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.655347] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.655898] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.655898] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 14c4bdb4-a63c-44da-8e31-cd8bd42ea288 is going to be created. [ 1024.675485] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.675485] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.675694] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.675905] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.676158] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.676382] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-14c4bdb4-a63c-44da-8e31-cd8bd42ea288" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.896246] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.281055] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 in Status: SUCCESS [ 1025.281055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.398631] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.398845] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.398845] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.399542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.399542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.399542] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 is going to be updated. [ 1025.423449] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.423597] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.423670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.423889] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.424046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.431527] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: IN_PROGRESS for 2s [ 1025.448031] env[71140]: INFO networking_nsxv3.common.synchronization [req-591668f4-7039-449e-8afa-c48cc5a5f5e1 req-843eb68b-dfc5-46ff-917a-556e6762f4a9 service nova] Enqueued Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_rules [ 1025.448703] env[71140]: INFO networking_nsxv3.common.synchronization [req-591668f4-7039-449e-8afa-c48cc5a5f5e1 req-843eb68b-dfc5-46ff-917a-556e6762f4a9 service nova] Enqueued Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 1025.448703] env[71140]: INFO networking_nsxv3.common.synchronization [req-591668f4-7039-449e-8afa-c48cc5a5f5e1 req-843eb68b-dfc5-46ff-917a-556e6762f4a9 service nova] Enqueued Resource ID: 14c4bdb4-a63c-44da-8e31-cd8bd42ea288 with Priority: HIGHEST for action port [ 1025.448703] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_rules [ 1025.448703] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 1025.448886] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c4bdb4-a63c-44da-8e31-cd8bd42ea288 with Priority: HIGHEST for action port [ 1025.449331] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.450218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.450218] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.450218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.450218] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-14c4bdb4-a63c-44da-8e31-cd8bd42ea288 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.450218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14c4bdb4-a63c-44da-8e31-cd8bd42ea288" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.450218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14c4bdb4-a63c-44da-8e31-cd8bd42ea288" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.450218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14c4bdb4-a63c-44da-8e31-cd8bd42ea288" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.450629] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14c4bdb4-a63c-44da-8e31-cd8bd42ea288',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.954359] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14c4bdb4-a63c-44da-8e31-cd8bd42ea288 with status ACTIVE [ 1025.954767] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.954767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.954767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.954997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.955117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.955247] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.955385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.955445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.955615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.955726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.955914] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.956044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.956116] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.956272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.956358] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.956444] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14c4bdb4-a63c-44da-8e31-cd8bd42ea288 is going to be updated. [ 1025.976796] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.976974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.977032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.977231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.977408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.977562] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14c4bdb4-a63c-44da-8e31-cd8bd42ea288" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.449256] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 in Status: SUCCESS [ 1026.449488] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.449536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.449764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.449872] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.939552] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.939794] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-600" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.939930] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-600" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.940220] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-600" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.940486] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.940649] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.940769] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.940988] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.941148] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.941358] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1026.941472] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.941582] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.941692] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.941797] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1026.941905] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.942052] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.951559] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2548cfa1-8571-4be8-becb-2b5d950d7202 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.951674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.951674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.951842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.951989] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.952097] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.952157] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.952302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.952384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.952469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.952557] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.960897] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.961153] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1026.961246] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.961380] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-600" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.961648] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-79048504-5fc2-4884-9daf-c99163754397 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.961814] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-79048504-5fc2-4884-9daf-c99163754397" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.961938] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-79048504-5fc2-4884-9daf-c99163754397" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.962177] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-79048504-5fc2-4884-9daf-c99163754397" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.962314] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79048504-5fc2-4884-9daf-c99163754397',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.442196] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: SUCCESS [ 1027.442656] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.442818] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.443109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.443468] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.443852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.443852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.444105] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.444280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.444448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.444627] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.445597] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.445806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.446128] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.446283] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.446402] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.446648] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.446743] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.446906] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.454585] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2548cfa1-8571-4be8-becb-2b5d950d7202 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.454726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.454798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.454993] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.455252] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.455417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.455494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.455670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.455770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.455867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.456094] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2548cfa1-8571-4be8-becb-2b5d950d7202 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.456241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.456306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.456459] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.456618] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.456786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.456839] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.457041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.457093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.457139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.457225] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.464042] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.464269] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.464422] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.464715] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.464895] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.465275] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.465438] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.465564] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.465784] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.465928] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.466231] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.466391] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.466514] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.466783] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.466934] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.467171] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 79048504-5fc2-4884-9daf-c99163754397 is going to be updated. [ 1027.487710] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.487936] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.488075] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.488349] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.488581] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.488813] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-79048504-5fc2-4884-9daf-c99163754397" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.949429] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.949571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.950883] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.959656] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2548cfa1-8571-4be8-becb-2b5d950d7202: rpc.has_security_group_logging(os_id): False [ 1027.976445] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.976764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.976764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.976890] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.976983] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.977216] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.977319] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.977383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.977570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.977653] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.977844] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.977956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.978030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.978175] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.978249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.978430] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.978520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.978580] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.979015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.979157] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.979283] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 is going to be updated. [ 1028.035245] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.036856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.036972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.037279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.037788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.050567] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 in Status: IN_PROGRESS for 2s [ 1028.238720] env[71140]: INFO networking_nsxv3.common.synchronization [req-46f7d2cd-bb94-49a3-8cad-7d53321bfd26 req-afc6c792-09f7-4f55-9f58-10390c93b89f service nova] Enqueued Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGHEST for action security_group_rules [ 1028.238978] env[71140]: INFO networking_nsxv3.common.synchronization [req-46f7d2cd-bb94-49a3-8cad-7d53321bfd26 req-afc6c792-09f7-4f55-9f58-10390c93b89f service nova] Enqueued Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGHEST for action security_group_members [ 1028.239228] env[71140]: INFO networking_nsxv3.common.synchronization [req-46f7d2cd-bb94-49a3-8cad-7d53321bfd26 req-afc6c792-09f7-4f55-9f58-10390c93b89f service nova] Enqueued Resource ID: 79048504-5fc2-4884-9daf-c99163754397 with Priority: HIGHEST for action port [ 1028.239741] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGHEST for action security_group_rules [ 1028.239898] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGHEST for action security_group_members [ 1028.239997] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79048504-5fc2-4884-9daf-c99163754397 with Priority: HIGHEST for action port [ 1028.240278] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.240399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.240468] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.240668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.240752] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.241820] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.241820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.241820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.241948] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.242033] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.242105] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.242172] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.242316] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.242400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.242489] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.243201] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-79048504-5fc2-4884-9daf-c99163754397 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.243311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79048504-5fc2-4884-9daf-c99163754397" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.243380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79048504-5fc2-4884-9daf-c99163754397" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.243555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79048504-5fc2-4884-9daf-c99163754397" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.243654] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79048504-5fc2-4884-9daf-c99163754397',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.456148] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.745126] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.746237] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.746346] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.748054] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79048504-5fc2-4884-9daf-c99163754397 with status ACTIVE [ 1028.748231] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.748373] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.748469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.748726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.748841] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.749155] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.749263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.749383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.749517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.749601] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.749863] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.749982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.750062] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.750207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.750287] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.750391] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79048504-5fc2-4884-9daf-c99163754397 is going to be updated. [ 1028.773706] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.773973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.773973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.774295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.774488] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.774766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79048504-5fc2-4884-9daf-c99163754397" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.958608] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.958698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.958802] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.958995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.959134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.959242] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 is going to be updated. [ 1028.988812] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.989276] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.989276] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.989276] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.989521] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.000733] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: IN_PROGRESS for 2s [ 1029.248506] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.751470] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.751675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.751675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.751862] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.751956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.752070] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 is going to be updated. [ 1029.769490] env[71140]: INFO networking_nsxv3.common.synchronization [req-663c3c14-fcd0-455b-bcff-571790a9eba4 req-d5b8a2d6-f115-4d95-a7ee-c0f92c5dc6a8 tempest-DeleteServersTestJSON-1199867382 tempest-DeleteServersTestJSON-1199867382-project-member] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1029.770190] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1029.770581] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.770801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.770923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.771189] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.771446] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.771446] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.771604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.771734] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.771844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.771920] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.775518] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.776061] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.776061] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.776061] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.776061] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.784357] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 in Status: IN_PROGRESS for 2s [ 1030.077552] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 in Status: SUCCESS [ 1030.077552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.090323] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-351 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.090652] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.090876] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.091311] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.091758] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.092115] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.092336] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.092696] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.092993] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.093337] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.093551] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.093755] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.093960] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.094187] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.094422] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.094662] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.133031] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.133031] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1030.133031] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.133031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.133031] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-534f9980-a215-4094-8402-837b6564cb92 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.133031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-534f9980-a215-4094-8402-837b6564cb92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.133031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-534f9980-a215-4094-8402-837b6564cb92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.133031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-534f9980-a215-4094-8402-837b6564cb92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.133031] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('534f9980-a215-4094-8402-837b6564cb92',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.274657] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.274869] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.274944] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.276183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.276340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.279804] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.279804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.279804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.279804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.279804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.279804] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be updated. [ 1030.302753] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.305766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.305766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.305766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.305766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.317881] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 1030.637970] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.638298] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.638474] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.639063] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.639243] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.639407] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 534f9980-a215-4094-8402-837b6564cb92 not found, creating... [ 1030.639794] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.639966] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.640098] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.640377] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.640535] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.640830] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.640986] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.641116] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.641702] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.641702] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.641702] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 534f9980-a215-4094-8402-837b6564cb92 is going to be created. [ 1030.660211] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.660440] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.660574] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.660851] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.661097] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.661383] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-534f9980-a215-4094-8402-837b6564cb92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.007769] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: SUCCESS [ 1031.007769] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.007769] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.008030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.009081] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.009081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.009081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.009081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.009081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.009081] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.423665] env[71140]: INFO networking_nsxv3.common.synchronization [req-663c3c14-fcd0-455b-bcff-571790a9eba4 req-ce28a03d-f340-4aa2-a04c-763f6998201f service nova] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_rules [ 1031.423972] env[71140]: INFO networking_nsxv3.common.synchronization [req-663c3c14-fcd0-455b-bcff-571790a9eba4 req-ce28a03d-f340-4aa2-a04c-763f6998201f service nova] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1031.424041] env[71140]: INFO networking_nsxv3.common.synchronization [req-663c3c14-fcd0-455b-bcff-571790a9eba4 req-ce28a03d-f340-4aa2-a04c-763f6998201f service nova] Enqueued Resource ID: 534f9980-a215-4094-8402-837b6564cb92 with Priority: HIGHEST for action port [ 1031.424251] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_rules [ 1031.424382] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1031.424480] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 534f9980-a215-4094-8402-837b6564cb92 with Priority: HIGHEST for action port [ 1031.427254] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.427254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.427254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.427254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.427254] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.428758] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.428758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.428758] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-534f9980-a215-4094-8402-837b6564cb92 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.428758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-534f9980-a215-4094-8402-837b6564cb92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.428758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-534f9980-a215-4094-8402-837b6564cb92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.428758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-534f9980-a215-4094-8402-837b6564cb92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.429136] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('534f9980-a215-4094-8402-837b6564cb92',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.511211] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.792401] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 in Status: SUCCESS [ 1031.792665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.792864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.793119] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.793319] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.793457] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.793523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.793688] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.793791] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.793888] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.793981] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.931410] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.931410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.932652] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 534f9980-a215-4094-8402-837b6564cb92 with status ACTIVE [ 1031.932835] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.932957] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.933055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.933338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.933455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.933658] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.933786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.933888] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.934081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.934217] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.934457] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.934546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.934594] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.934746] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.934838] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.934953] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 534f9980-a215-4094-8402-837b6564cb92 is going to be updated. [ 1031.955018] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.955268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.955268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.955502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.955683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.955858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-534f9980-a215-4094-8402-837b6564cb92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.013440] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.300527] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.310388] env[71140]: INFO networking_nsxv3.common.synchronization [req-43e7b32b-5241-4034-91f5-46e802e5832b req-b74bf5f0-948c-4bd4-b846-cf40bede8ed0 tempest-ServersTestJSON-1092316267 tempest-ServersTestJSON-1092316267-project-member] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1032.311074] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1032.311857] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.311857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.311857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.311857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.312174] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.312174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.312174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.312299] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.313246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.313246] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.328506] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 1032.328832] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 deletion is rescheduled due to dependency. [ 1032.328962] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.329565] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.329803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.330272] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.330456] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.330565] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.330780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.330914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.331025] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.516560] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.517051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.517051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.517051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.517174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.517264] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 is going to be updated. [ 1032.543442] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.543702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.543702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.544230] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.544373] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.552799] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: IN_PROGRESS for 2s [ 1032.675246] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-452 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.675480] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.675799] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.676273] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.676587] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.676813] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.676955] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.677245] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.677432] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.677768] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.677923] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.678077] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.678222] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.678438] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.678506] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.678740] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.696037] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.696175] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1032.696249] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.696424] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.696745] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-c40368d8-fe28-4f1f-9220-f0629dfc3ac9 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.696926] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-c40368d8-fe28-4f1f-9220-f0629dfc3ac9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.697062] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-c40368d8-fe28-4f1f-9220-f0629dfc3ac9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.697449] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-c40368d8-fe28-4f1f-9220-f0629dfc3ac9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.697590] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c40368d8-fe28-4f1f-9220-f0629dfc3ac9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.803139] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94b91392-e2c9-4bb1-8e2f-6bc3569d8721: rpc.has_security_group_logging(os_id): False [ 1032.815959] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.815959] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.815959] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.816337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.816337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.816529] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.816639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.816698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.816859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.816943] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.817044] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 already deleted. [ 1032.817116] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.819805] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.820024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.820163] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.820355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.820445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.820741] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.820911] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.820986] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.821158] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.821253] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.821332] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 is going to be updated. [ 1032.832838] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.874908] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.875152] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.875229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.875454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.875612] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.896607] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 in Status: IN_PROGRESS for 2s [ 1033.200149] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.200409] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.200797] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.200914] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.201011] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.201208] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port c40368d8-fe28-4f1f-9220-f0629dfc3ac9 not found, creating... [ 1033.201518] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.201678] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.201827] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.202129] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.202312] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.202619] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.202800] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.202937] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.203192] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.203329] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.203552] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: c40368d8-fe28-4f1f-9220-f0629dfc3ac9 is going to be created. [ 1033.223686] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.223953] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.224259] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.224594] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.224856] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.225185] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-c40368d8-fe28-4f1f-9220-f0629dfc3ac9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.335265] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.837856] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.838288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.838288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.838390] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.838390] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.838474] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be updated. [ 1033.865162] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.865367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.865367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.865610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.865754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.874272] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 1033.962214] env[71140]: INFO networking_nsxv3.common.synchronization [req-43e7b32b-5241-4034-91f5-46e802e5832b req-b2304639-3c78-42ac-bff3-30fa78948ca3 service nova] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_rules [ 1033.962413] env[71140]: INFO networking_nsxv3.common.synchronization [req-43e7b32b-5241-4034-91f5-46e802e5832b req-b2304639-3c78-42ac-bff3-30fa78948ca3 service nova] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1033.962560] env[71140]: INFO networking_nsxv3.common.synchronization [req-43e7b32b-5241-4034-91f5-46e802e5832b req-b2304639-3c78-42ac-bff3-30fa78948ca3 service nova] Enqueued Resource ID: c40368d8-fe28-4f1f-9220-f0629dfc3ac9 with Priority: HIGHEST for action port [ 1033.962805] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_rules [ 1033.962938] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1033.963035] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c40368d8-fe28-4f1f-9220-f0629dfc3ac9 with Priority: HIGHEST for action port [ 1033.963623] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.963747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.963907] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.965880] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.965997] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.966989] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.967142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.967223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.967395] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.967552] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.967686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.967747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.967919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.968019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.968111] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.968941] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-c40368d8-fe28-4f1f-9220-f0629dfc3ac9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.969072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c40368d8-fe28-4f1f-9220-f0629dfc3ac9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.969116] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c40368d8-fe28-4f1f-9220-f0629dfc3ac9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.969277] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c40368d8-fe28-4f1f-9220-f0629dfc3ac9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.969350] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c40368d8-fe28-4f1f-9220-f0629dfc3ac9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.473152] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.473152] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.473152] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.473152] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c40368d8-fe28-4f1f-9220-f0629dfc3ac9 with status ACTIVE [ 1034.473152] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.473876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.473876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.473876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.473876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.473876] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.473876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.474307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.474307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.474307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.474493] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.474493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.474493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.474694] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.474733] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.474847] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c40368d8-fe28-4f1f-9220-f0629dfc3ac9 is going to be updated. [ 1034.498643] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.498643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.498643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.500339] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.500339] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.500339] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c40368d8-fe28-4f1f-9220-f0629dfc3ac9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.565088] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: SUCCESS [ 1034.565303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.565515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.565761] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.565955] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.566100] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.566176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.566384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.566464] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.566502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.566651] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.566851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.566932] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.567253] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.567417] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.567516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.567581] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.567885] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.567885] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.568008] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.568048] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.915105] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 in Status: SUCCESS [ 1034.915105] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.977327] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.069951] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 878a96b3-04c2-49e0-a7d2-cbbb47bf5319: rpc.has_security_group_logging(os_id): False [ 1035.092063] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.092380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.092480] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.093062] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.093062] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.093062] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.093274] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.093274] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.093459] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.093614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.093864] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.093997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.094341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.094584] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.094717] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.094965] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.095116] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.095209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.095566] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.095712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.095836] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 is going to be updated. [ 1035.165929] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.166212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.166212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.166424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.166574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.182276] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: IN_PROGRESS for 2s [ 1035.480573] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.480788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.480884] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.482043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.482043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.482043] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be created. [ 1035.515531] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.515531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.515531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.515531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.515866] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.530935] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: UNINITIALIZED for 2s [ 1035.889442] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 1035.889771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.889981] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.890222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.890429] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.890562] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.890622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.890780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.890859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.890935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.891050] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.366377] env[71140]: INFO networking_nsxv3.common.synchronization [req-0408416b-1bb8-4fa5-802b-5be91e546989 req-185187cc-db54-48e7-8d72-0cfdf444ea6e tempest-MultipleCreateTestJSON-727311014 tempest-MultipleCreateTestJSON-727311014-project-member] Enqueued Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 1036.367045] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 1036.367405] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.367561] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.367672] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.369843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.369843] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.369843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.369843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.369843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.369843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.369843] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.394688] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.394876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.394955] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.395180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.395356] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.395454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.395510] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.395666] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.395755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.395844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.395992] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.396096] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.396148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.396318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.396430] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.396516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.396573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.396708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.396785] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.396866] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.396955] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.778608] env[71140]: INFO networking_nsxv3.common.synchronization [None req-c21f0a5b-d6b5-4318-88ed-a33ebbe9117e tempest-AttachVolumeNegativeTest-950002537 tempest-AttachVolumeNegativeTest-950002537-project-member] Enqueued Resource ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 with Priority: HIGHEST for action security_group_rules [ 1036.779273] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 with Priority: HIGHEST for action security_group_rules [ 1036.779580] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.779703] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.779775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.781139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.781339] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8623c530-dbd9-4cff-983a-f2df2ac9ad58',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.870496] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.900568] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c549bd3-468a-4655-b709-3480ff374e11: rpc.has_security_group_logging(os_id): False [ 1036.920439] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.921523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.921626] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.921831] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.921930] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.922172] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.922282] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.922348] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.922511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.922591] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.922787] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.922887] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.923143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.923375] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.923511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.923745] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.923910] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.924022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.924384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.924384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.924384] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be updated. [ 1036.994894] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.994894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.994894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.994894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.994894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.997908] env[71140]: INFO networking_nsxv3.common.synchronization [None req-40ff72c5-98b3-4f70-8c86-9d6c5935f51f tempest-AttachVolumeNegativeTest-950002537 tempest-AttachVolumeNegativeTest-950002537-project-member] Enqueued Resource ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 with Priority: HIGHEST for action security_group_rules [ 1036.999045] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 with Priority: HIGHEST for action security_group_rules [ 1037.000228] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.000228] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.026593] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 1037.199250] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: SUCCESS [ 1037.199515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.199703] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.199945] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.200191] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.306116] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.306266] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.306345] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.306567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.306687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.306760] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 already deleted. [ 1037.306836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.306992] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.307168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.307251] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8623c530-dbd9-4cff-983a-f2df2ac9ad58',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.373912] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.513256] env[71140]: INFO networking_nsxv3.common.synchronization [req-73c37868-73a1-4ac3-8a1a-a96771c54d3d req-8282da7a-1103-4f18-93f3-1b1bcaed40c0 tempest-MultipleCreateTestJSON-727311014 tempest-MultipleCreateTestJSON-727311014-project-member] Enqueued Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 1037.513797] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 with Priority: HIGHEST for action security_group_members [ 1037.514635] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.514635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.541829] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1037.541829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.541829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.541829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.541829] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.541829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.541829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.541829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.541829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.541829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.541829] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.702803] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.702968] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.829623] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.829778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.829889] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.830092] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.830183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.830282] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 already deleted. [ 1037.830364] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.879073] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.879312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.879459] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.879727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.879906] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.880348] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 is going to be updated. [ 1037.906219] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.906749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.906829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.907172] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.907371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.915810] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: IN_PROGRESS for 2s [ 1038.046126] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.047091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.047222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.047435] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.047663] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.047833] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.047910] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.048223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.048327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.048424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.048679] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.048810] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.048872] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.049111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.049303] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.049459] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.049525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.050208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.050287] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.050445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.050551] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.182975] env[71140]: INFO networking_nsxv3.common.synchronization [req-95989547-17a3-4499-951e-87386f8510f3 req-05d5843a-9766-4168-af68-77a54d6316b7 tempest-ServerRescueNegativeTestJSON-432250818 tempest-ServerRescueNegativeTestJSON-432250818-project-member] Enqueued Resource ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d with Priority: HIGHEST for action security_group_members [ 1038.186482] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d with Priority: HIGHEST for action security_group_members [ 1038.187206] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.187341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.187412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.187722] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.187912] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.188032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.188096] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.188313] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.188504] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.188556] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f8a236-f7eb-4e78-a4ac-ee225ba9532d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.553580] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e8717ad-052a-4a86-b223-df55dd81c619: rpc.has_security_group_logging(os_id): False [ 1038.576335] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.576509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.576554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.576853] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.576965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.577142] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.577246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.577303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.577466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.577541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.577769] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.577872] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.577935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.578101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.578178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.578372] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.578472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.578557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.578795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.578930] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.579014] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be created. [ 1038.636807] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.636995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.636995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.637279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.637482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.651059] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1038.693096] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.693264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.693332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.693555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.693642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.693846] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.693943] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.693998] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.694170] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.694242] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.694327] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d is going to be updated. [ 1038.728347] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.728728] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.728942] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.729232] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.729384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.740631] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d in Status: IN_PROGRESS for 2s [ 1039.043754] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 1039.043935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.521431] env[71140]: INFO networking_nsxv3.common.synchronization [None req-8a5b41e3-c7d7-4720-8889-8bfc4cfe3e08 None None] Enqueued Resource ID: 1a62d646-8d0e-4683-b812-36d7e23e94ae with Priority: HIGHEST for action port [ 1039.521431] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a62d646-8d0e-4683-b812-36d7e23e94ae with Priority: HIGHEST for action port [ 1039.521431] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a62d646-8d0e-4683-b812-36d7e23e94ae taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.523049] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a62d646-8d0e-4683-b812-36d7e23e94ae" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.523196] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a62d646-8d0e-4683-b812-36d7e23e94ae" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.523686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a62d646-8d0e-4683-b812-36d7e23e94ae" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.523934] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a62d646-8d0e-4683-b812-36d7e23e94ae',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.928603] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: SUCCESS [ 1039.928603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.928603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.928603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.928603] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.928603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.928603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.928603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.928603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.928603] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.030033] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a62d646-8d0e-4683-b812-36d7e23e94ae [ 1040.030033] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.030033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.030351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.030442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.030543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.030666] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a62d646-8d0e-4683-b812-36d7e23e94ae already deleted. [ 1040.030762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a62d646-8d0e-4683-b812-36d7e23e94ae" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.402222] env[71140]: INFO networking_nsxv3.common.synchronization [None req-369349f1-3c7f-4ab4-ab83-1c2d62fd6400 tempest-AttachInterfacesUnderV243Test-701512252 tempest-AttachInterfacesUnderV243Test-701512252-project-member] Enqueued Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_rules [ 1040.402784] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_rules [ 1040.403144] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77acb82c-557e-4c76-a0f0-8f86422bacf5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.403602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.403700] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.403990] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.407253] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.431836] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.432038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.432129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.432466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.432466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.432638] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.433896] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.434437] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.434437] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.434437] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.434585] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 is going to be updated. [ 1040.465220] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.465395] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.465456] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.465707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.465996] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.476811] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: IN_PROGRESS for 2s [ 1040.541525] env[71140]: INFO networking_nsxv3.common.synchronization [None req-f32a71d5-22c3-43c9-9c89-814424667b9d tempest-AttachInterfacesUnderV243Test-701512252 tempest-AttachInterfacesUnderV243Test-701512252-project-member] Enqueued Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_rules [ 1040.542109] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_rules [ 1040.542436] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77acb82c-557e-4c76-a0f0-8f86422bacf5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.542533] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.667154] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1040.667154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.751650] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d in Status: SUCCESS [ 1040.752569] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d deletion is rescheduled due to dependency. [ 1040.752569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.928667] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.928667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.928667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.928667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.928667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.928667] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 already deleted. [ 1040.928667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.928667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.929215] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.929215] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.451009] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.451184] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.451274] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.451515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.452035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.452035] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 already deleted. [ 1041.452035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.696049] env[71140]: INFO networking_nsxv3.common.synchronization [req-45bc2084-d450-40c2-a767-9d6a1ff8fe34 req-35fbef62-3b74-46aa-a040-be8eb60e5e14 tempest-ServerDiskConfigTestJSON-63292790 tempest-ServerDiskConfigTestJSON-63292790-project-member] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 1041.696411] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 1041.696733] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.696863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.696960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.697606] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.697725] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.697883] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.697977] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.698210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.698307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.699764] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.205464] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.205816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.205896] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.206103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.206203] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.206411] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.206511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.206573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.206757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.206960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.206960] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 1042.234654] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.234802] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.234896] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.235096] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.235241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.246302] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 1042.486658] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: SUCCESS [ 1042.487735] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 deletion is rescheduled due to dependency. [ 1042.487735] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.489878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.489878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.489878] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.489878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.489878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.489878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.489878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.489878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.489878] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.589811] env[71140]: INFO networking_nsxv3.common.synchronization [None req-cc84b353-a224-4b98-9eb2-d2543b4aaae4 None None] Enqueued Resource ID: 31a59299-18da-4a54-bfd3-8bc3a1523bc7 with Priority: HIGHEST for action port [ 1042.590523] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a59299-18da-4a54-bfd3-8bc3a1523bc7 with Priority: HIGHEST for action port [ 1042.594381] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-31a59299-18da-4a54-bfd3-8bc3a1523bc7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.594698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31a59299-18da-4a54-bfd3-8bc3a1523bc7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.594698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31a59299-18da-4a54-bfd3-8bc3a1523bc7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.595023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31a59299-18da-4a54-bfd3-8bc3a1523bc7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.595151] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31a59299-18da-4a54-bfd3-8bc3a1523bc7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.992754] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.992754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.992754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.992998] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.993162] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.993269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.993327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.993664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.993664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.993664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.993805] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.993897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.993958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.994121] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.994256] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.994350] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.994399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.994536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.994603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.994683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.994771] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('878a96b3-04c2-49e0-a7d2-cbbb47bf5319',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.099355] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31a59299-18da-4a54-bfd3-8bc3a1523bc7 [ 1043.099590] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.099726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.099783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.099991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.100173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.100270] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31a59299-18da-4a54-bfd3-8bc3a1523bc7 already deleted. [ 1043.100306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31a59299-18da-4a54-bfd3-8bc3a1523bc7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.497216] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 878a96b3-04c2-49e0-a7d2-cbbb47bf5319: rpc.has_security_group_logging(os_id): False [ 1043.514867] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.515102] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.515102] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.515608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.515608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.515730] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.515811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.515890] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.516300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.516300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.516446] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.516525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.516525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.516676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.516754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.516932] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.517035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.517094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.517227] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.517296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.517377] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 is going to be updated. [ 1043.575760] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.575997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.576079] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.576310] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.576454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.591737] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: IN_PROGRESS for 2s [ 1044.255551] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 1044.255551] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 deletion is rescheduled due to dependency. [ 1044.255551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.608309] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 878a96b3-04c2-49e0-a7d2-cbbb47bf5319 in Status: SUCCESS [ 1045.608615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-878a96b3-04c2-49e0-a7d2-cbbb47bf5319" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.236981] env[71140]: INFO networking_nsxv3.common.synchronization [None req-566f89ab-2d8d-405a-b105-433f1b0de527 None None] Enqueued Resource ID: 6dafca3a-9394-449c-ad51-3d8e9f6bb82b with Priority: HIGHEST for action port [ 1046.237272] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dafca3a-9394-449c-ad51-3d8e9f6bb82b with Priority: HIGHEST for action port [ 1046.237828] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dafca3a-9394-449c-ad51-3d8e9f6bb82b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.237995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dafca3a-9394-449c-ad51-3d8e9f6bb82b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.238097] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dafca3a-9394-449c-ad51-3d8e9f6bb82b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.238339] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dafca3a-9394-449c-ad51-3d8e9f6bb82b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.238441] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dafca3a-9394-449c-ad51-3d8e9f6bb82b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.740216] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6dafca3a-9394-449c-ad51-3d8e9f6bb82b [ 1046.740530] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.740621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.740679] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.740845] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.740942] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.741060] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6dafca3a-9394-449c-ad51-3d8e9f6bb82b already deleted. [ 1046.741143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dafca3a-9394-449c-ad51-3d8e9f6bb82b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.310519] env[71140]: INFO networking_nsxv3.common.synchronization [req-ef2c69c7-b470-4396-a607-0fd2cfad5bd9 req-b30160a6-beee-4bfe-aa65-79b4c9200352 tempest-ServerActionsTestOtherA-289074452 tempest-ServerActionsTestOtherA-289074452-project-member] Enqueued Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGHEST for action security_group_members [ 1047.310625] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGHEST for action security_group_members [ 1047.311443] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7015c2-a058-452d-bfd5-0575d4a237f8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.311763] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.311838] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.312162] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.312479] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.312596] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.312653] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.312825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.312908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.313012] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.424051] env[71140]: INFO networking_nsxv3.common.synchronization [req-1eca668c-3ea3-4b71-bd62-5dc82db29ba4 req-4c887539-efec-435d-a928-c31e0dda1ffe tempest-DeleteServersTestJSON-1199867382 tempest-DeleteServersTestJSON-1199867382-project-member] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1047.424051] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1047.424051] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.424051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.424051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.424561] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.424985] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.425296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.425513] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.425795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.425985] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.426181] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.743125] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-53 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.743447] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.743506] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.743807] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.744263] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.744599] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.744599] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.744800] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.744950] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.745207] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.745328] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.745440] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.745552] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.745660] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.745765] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.745900] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.770798] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.770798] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1047.770798] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.770798] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.771089] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-833cb14c-a6ba-420b-bdbd-5c380475b9b6 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.771210] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-833cb14c-a6ba-420b-bdbd-5c380475b9b6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.771337] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-833cb14c-a6ba-420b-bdbd-5c380475b9b6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.771836] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-833cb14c-a6ba-420b-bdbd-5c380475b9b6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.772059] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('833cb14c-a6ba-420b-bdbd-5c380475b9b6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.818281] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.819709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.819709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.819709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.819709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.819709] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.819709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.819709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.819709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.819709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.819709] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 already deleted. [ 1047.819709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.930035] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.930035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.930035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.930035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.930035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.930035] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.930035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.930035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.930035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.930035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.930035] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be updated. [ 1047.972595] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.972762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.972905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.973630] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.973786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.988831] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 1048.276600] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.276922] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.277076] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.277376] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.277530] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.277686] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 833cb14c-a6ba-420b-bdbd-5c380475b9b6 not found, creating... [ 1048.278038] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.278235] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.278388] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.278675] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.278865] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.280523] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.280657] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.280874] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.281181] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.281443] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.281627] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 833cb14c-a6ba-420b-bdbd-5c380475b9b6 is going to be created. [ 1048.301467] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.301657] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.302169] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.302542] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.302785] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.303029] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-833cb14c-a6ba-420b-bdbd-5c380475b9b6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.966368] env[71140]: INFO networking_nsxv3.common.synchronization [None req-b8db187e-6991-4c9c-baad-70bd9d993a5f None None] Enqueued Resource ID: 1bac264c-a83c-4a60-9f06-257e64c87552 with Priority: HIGHEST for action port [ 1048.966368] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bac264c-a83c-4a60-9f06-257e64c87552 with Priority: HIGHEST for action port [ 1048.966368] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bac264c-a83c-4a60-9f06-257e64c87552 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.966368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bac264c-a83c-4a60-9f06-257e64c87552" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.966368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bac264c-a83c-4a60-9f06-257e64c87552" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.966368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bac264c-a83c-4a60-9f06-257e64c87552" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.966830] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bac264c-a83c-4a60-9f06-257e64c87552',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.079966] env[71140]: INFO networking_nsxv3.common.synchronization [req-ef2c69c7-b470-4396-a607-0fd2cfad5bd9 req-e416c28e-50fa-455b-954b-853f21630bb0 service nova] Enqueued Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGHEST for action security_group_rules [ 1049.079966] env[71140]: INFO networking_nsxv3.common.synchronization [req-ef2c69c7-b470-4396-a607-0fd2cfad5bd9 req-e416c28e-50fa-455b-954b-853f21630bb0 service nova] Enqueued Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGHEST for action security_group_members [ 1049.079966] env[71140]: INFO networking_nsxv3.common.synchronization [req-ef2c69c7-b470-4396-a607-0fd2cfad5bd9 req-e416c28e-50fa-455b-954b-853f21630bb0 service nova] Enqueued Resource ID: 833cb14c-a6ba-420b-bdbd-5c380475b9b6 with Priority: HIGHEST for action port [ 1049.079966] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGHEST for action security_group_rules [ 1049.079966] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGHEST for action security_group_members [ 1049.079966] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 833cb14c-a6ba-420b-bdbd-5c380475b9b6 with Priority: HIGHEST for action port [ 1049.079966] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc7015c2-a058-452d-bfd5-0575d4a237f8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.079966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.079966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.079966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.080520] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.082638] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7015c2-a058-452d-bfd5-0575d4a237f8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.082729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.082768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.082952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.083124] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.084022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.084022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.084022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.084022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.084022] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.084345] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-833cb14c-a6ba-420b-bdbd-5c380475b9b6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.084514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-833cb14c-a6ba-420b-bdbd-5c380475b9b6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.084514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-833cb14c-a6ba-420b-bdbd-5c380475b9b6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.084854] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-833cb14c-a6ba-420b-bdbd-5c380475b9b6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.084854] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('833cb14c-a6ba-420b-bdbd-5c380475b9b6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.449302] env[71140]: INFO networking_nsxv3.common.synchronization [req-2596e90d-c6af-494c-a485-472d4eaac41d req-cdbe79e2-937e-49f0-b6ef-2d46124276a2 tempest-ServersV294TestFqdnHostnames-519452335 tempest-ServersV294TestFqdnHostnames-519452335-project-member] Enqueued Resource ID: f3b2c834-9214-45cf-a32f-db5f411105f6 with Priority: HIGHEST for action security_group_members [ 1049.449302] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b2c834-9214-45cf-a32f-db5f411105f6 with Priority: HIGHEST for action security_group_members [ 1049.449302] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b2c834-9214-45cf-a32f-db5f411105f6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.449302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.450676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.450676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.450826] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.450883] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.450921] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.451127] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.451217] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.451561] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b2c834-9214-45cf-a32f-db5f411105f6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.468825] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1bac264c-a83c-4a60-9f06-257e64c87552 [ 1049.469079] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.469204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.469278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.469464] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.469553] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.469644] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1bac264c-a83c-4a60-9f06-257e64c87552 already deleted. [ 1049.469722] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bac264c-a83c-4a60-9f06-257e64c87552" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.586237] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7015c2-a058-452d-bfd5-0575d4a237f8 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.586384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.587333] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.587333] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 833cb14c-a6ba-420b-bdbd-5c380475b9b6 with status ACTIVE [ 1049.587550] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.587612] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.587788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.587863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.587978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.588222] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.588426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.588426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.588619] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.588666] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.588817] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.588913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.588954] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.590309] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.590717] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.592177] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 833cb14c-a6ba-420b-bdbd-5c380475b9b6 is going to be updated. [ 1049.612026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.612958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.612958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.612958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.612958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.612958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-833cb14c-a6ba-420b-bdbd-5c380475b9b6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.830950] env[71140]: INFO networking_nsxv3.common.synchronization [req-d752e4fa-99a0-4fa2-8d74-98b6efa02408 req-267fb7a0-203f-4a7f-8c55-8f2825307545 tempest-AttachVolumeNegativeTest-950002537 tempest-AttachVolumeNegativeTest-950002537-project-member] Enqueued Resource ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 with Priority: HIGHEST for action security_group_members [ 1049.831540] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 with Priority: HIGHEST for action security_group_members [ 1049.831840] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8623c530-dbd9-4cff-983a-f2df2ac9ad58 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.831962] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.832364] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.832643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.832803] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.832909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.832970] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.833212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.833301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.833395] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8623c530-dbd9-4cff-983a-f2df2ac9ad58',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.956240] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.956475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.956566] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.956792] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.956883] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.957179] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.961019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.961019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.961019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.961019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.961019] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b2c834-9214-45cf-a32f-db5f411105f6 is going to be updated. [ 1049.987231] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.987231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.987231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.987653] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.987653] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.996238] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b2c834-9214-45cf-a32f-db5f411105f6 in Status: IN_PROGRESS for 2s [ 1050.093513] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.166223] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-838 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.166349] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-838" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.166420] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-838" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.166877] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-838" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.170410] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.170410] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.170410] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.170410] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.170410] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.170410] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1050.170410] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1050.170410] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1050.170410] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1050.170410] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1050.170410] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1050.170410] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1050.192461] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1050.193428] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1050.193428] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1050.193428] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-838" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.193428] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-95c9e1e7-c5c0-4b5b-be12-d12a5db8d556 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.193698] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-95c9e1e7-c5c0-4b5b-be12-d12a5db8d556" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.193698] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-95c9e1e7-c5c0-4b5b-be12-d12a5db8d556" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.193961] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-95c9e1e7-c5c0-4b5b-be12-d12a5db8d556" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.196383] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95c9e1e7-c5c0-4b5b-be12-d12a5db8d556',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.337067] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.337067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.337067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.337067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.337067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.337067] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.337067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.337067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.337067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.337067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.337067] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 already deleted. [ 1050.337067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.417059] env[71140]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function GET Argumetns {'path': '/policy/api/v1/infra/realized-state/status', 'params': {'intent_path': '/infra/domains/default/groups/4c549bd3-468a-4655-b709-3480ff374e11'}} Response=('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')): requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [ 1050.417234] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=71140) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:122}} [ 1050.596093] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.596093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.596093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.596386] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.596386] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.596386] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 is going to be created. [ 1050.626965] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.627157] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.627157] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.627466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.627604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.637299] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 in Status: UNINITIALIZED for 2s [ 1050.703158] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.703158] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.703343] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.703606] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.703648] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.703799] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 95c9e1e7-c5c0-4b5b-be12-d12a5db8d556 not found, creating... [ 1050.704099] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.704280] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.704458] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.704706] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.704877] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.705201] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.705367] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.705470] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.705683] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.705821] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.706045] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 95c9e1e7-c5c0-4b5b-be12-d12a5db8d556 is going to be created. [ 1050.728033] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.728033] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.728033] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.728033] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.728324] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.728523] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-95c9e1e7-c5c0-4b5b-be12-d12a5db8d556" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.385239] env[71140]: INFO networking_nsxv3.common.synchronization [req-d752e4fa-99a0-4fa2-8d74-98b6efa02408 req-5e8029e1-d74a-49e5-af43-0fc57c8f7cfe service nova] Enqueued Resource ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 with Priority: HIGHEST for action security_group_rules [ 1051.385538] env[71140]: INFO networking_nsxv3.common.synchronization [req-d752e4fa-99a0-4fa2-8d74-98b6efa02408 req-5e8029e1-d74a-49e5-af43-0fc57c8f7cfe service nova] Enqueued Resource ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 with Priority: HIGHEST for action security_group_members [ 1051.385590] env[71140]: INFO networking_nsxv3.common.synchronization [req-d752e4fa-99a0-4fa2-8d74-98b6efa02408 req-5e8029e1-d74a-49e5-af43-0fc57c8f7cfe service nova] Enqueued Resource ID: 95c9e1e7-c5c0-4b5b-be12-d12a5db8d556 with Priority: HIGHEST for action port [ 1051.386164] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 with Priority: HIGHEST for action security_group_rules [ 1051.386345] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 with Priority: HIGHEST for action security_group_members [ 1051.386471] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95c9e1e7-c5c0-4b5b-be12-d12a5db8d556 with Priority: HIGHEST for action port [ 1051.386962] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.387142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.387234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.387576] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.387731] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8623c530-dbd9-4cff-983a-f2df2ac9ad58',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.388703] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8623c530-dbd9-4cff-983a-f2df2ac9ad58 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.388848] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.388939] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.389281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.389508] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.389642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.389729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.389913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.390034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.390154] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8623c530-dbd9-4cff-983a-f2df2ac9ad58',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.390926] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-95c9e1e7-c5c0-4b5b-be12-d12a5db8d556 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.391075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95c9e1e7-c5c0-4b5b-be12-d12a5db8d556" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.391167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95c9e1e7-c5c0-4b5b-be12-d12a5db8d556" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.391373] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95c9e1e7-c5c0-4b5b-be12-d12a5db8d556" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.391439] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95c9e1e7-c5c0-4b5b-be12-d12a5db8d556',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.893976] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8623c530-dbd9-4cff-983a-f2df2ac9ad58',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.895197] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8623c530-dbd9-4cff-983a-f2df2ac9ad58 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.895381] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.895613] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95c9e1e7-c5c0-4b5b-be12-d12a5db8d556 with status ACTIVE [ 1051.895862] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.896077] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.896208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.896456] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.896600] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.896856] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.897117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.897185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.897389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.897534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.897814] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.897982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.898079] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.898306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.898419] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.898938] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95c9e1e7-c5c0-4b5b-be12-d12a5db8d556 is going to be updated. [ 1051.918756] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.918912] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.918957] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.919252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.919470] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.919813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95c9e1e7-c5c0-4b5b-be12-d12a5db8d556" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.004995] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b2c834-9214-45cf-a32f-db5f411105f6 in Status: SUCCESS [ 1052.005200] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b2c834-9214-45cf-a32f-db5f411105f6 deletion is rescheduled due to dependency. [ 1052.005310] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.261739] env[71140]: INFO networking_nsxv3.common.synchronization [req-c7e5466e-9679-4850-aea4-d7637cec58f0 req-5efbd639-8e8f-4f61-99bf-b6ec02d27d09 tempest-ServerDiskConfigTestJSON-63292790 tempest-ServerDiskConfigTestJSON-63292790-project-member] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 1052.262465] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 1052.262967] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.263211] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.263491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.263817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.264092] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.264278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.264406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.264643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.264807] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.264965] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.401380] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8623c530-dbd9-4cff-983a-f2df2ac9ad58',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.427189] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 1052.427355] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 deletion is rescheduled due to dependency. [ 1052.427469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.561507] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.561695] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.561856] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.562483] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.562824] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.562824] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.563736] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.563736] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.563736] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.563736] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1052.563736] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.563736] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.563987] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.563987] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1052.564062] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.564574] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.586021] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.586021] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1052.586021] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.586021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-211" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.586021] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-d67c03df-a158-4282-b75c-c7afe6241af2 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.586021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-d67c03df-a158-4282-b75c-c7afe6241af2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.586021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-d67c03df-a158-4282-b75c-c7afe6241af2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.586021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-d67c03df-a158-4282-b75c-c7afe6241af2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.586603] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d67c03df-a158-4282-b75c-c7afe6241af2',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.646262] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 in Status: SUCCESS [ 1052.646375] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.647049] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.647141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.647398] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.647565] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.647639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.647807] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.647892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.647980] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.648104] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.768022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.768211] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.768294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.768530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.768624] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.768829] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.768956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.769042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.769214] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.769293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.769385] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 1052.799358] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.799524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.799573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.799753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.799889] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.808259] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 1052.903510] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.903698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.903698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.903881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.903975] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.904094] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 is going to be created. [ 1052.926672] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.926856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.926911] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.928520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.928520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.937087] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 in Status: UNINITIALIZED for 2s [ 1053.090314] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.090596] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.090728] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.091067] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.091237] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.091418] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port d67c03df-a158-4282-b75c-c7afe6241af2 not found, creating... [ 1053.091674] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.091833] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.091962] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.092211] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.092378] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.092644] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.092830] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.092957] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.093193] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.093353] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.093494] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: d67c03df-a158-4282-b75c-c7afe6241af2 is going to be created. [ 1053.111703] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.111996] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.112161] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.112427] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.112656] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.112877] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-d67c03df-a158-4282-b75c-c7afe6241af2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.151388] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7015c2-a058-452d-bfd5-0575d4a237f8 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.151566] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.151631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.151894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.151985] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.152100] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.152164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.152313] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.152499] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.152641] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.152801] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7015c2-a058-452d-bfd5-0575d4a237f8 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.152898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.152965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.153123] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.153269] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.153363] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.153404] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.153637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.153637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.153705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.153781] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.658802] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc7015c2-a058-452d-bfd5-0575d4a237f8: rpc.has_security_group_logging(os_id): False [ 1053.678020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.678020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.678020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.678020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.678020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.678020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.678020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.678020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.678020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.678020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.678020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.678020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.678020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.678999] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.678999] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.678999] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.678999] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.678999] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.680492] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.680492] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.680492] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 is going to be created. [ 1053.734142] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.734321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.734415] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.737130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.737227] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.746776] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 in Status: IN_PROGRESS for 2s [ 1053.967161] env[71140]: INFO networking_nsxv3.common.synchronization [req-c7e5466e-9679-4850-aea4-d7637cec58f0 req-6663d328-cbdc-4e36-9631-629ad9bee651 service nova] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_rules [ 1053.967357] env[71140]: INFO networking_nsxv3.common.synchronization [req-c7e5466e-9679-4850-aea4-d7637cec58f0 req-6663d328-cbdc-4e36-9631-629ad9bee651 service nova] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 1053.967499] env[71140]: INFO networking_nsxv3.common.synchronization [req-c7e5466e-9679-4850-aea4-d7637cec58f0 req-6663d328-cbdc-4e36-9631-629ad9bee651 service nova] Enqueued Resource ID: d67c03df-a158-4282-b75c-c7afe6241af2 with Priority: HIGHEST for action port [ 1053.968234] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_rules [ 1053.968398] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 1053.968482] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d67c03df-a158-4282-b75c-c7afe6241af2 with Priority: HIGHEST for action port [ 1053.968791] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.968912] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.968979] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.969266] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.969351] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.971247] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.971380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.971627] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-d67c03df-a158-4282-b75c-c7afe6241af2 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.971749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d67c03df-a158-4282-b75c-c7afe6241af2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.971807] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d67c03df-a158-4282-b75c-c7afe6241af2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.972009] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d67c03df-a158-4282-b75c-c7afe6241af2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.972136] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d67c03df-a158-4282-b75c-c7afe6241af2',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.473507] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.473641] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.473853] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d67c03df-a158-4282-b75c-c7afe6241af2 with status ACTIVE [ 1054.474095] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.474181] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.474221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.474433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.474524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.474696] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.474791] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.475360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.475360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.475360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.475360] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.476681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.476681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.476681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.476681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.476681] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d67c03df-a158-4282-b75c-c7afe6241af2 is going to be updated. [ 1054.496512] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.496716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.496716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.497674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.497674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.497898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d67c03df-a158-4282-b75c-c7afe6241af2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.819019] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 1054.819019] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 deletion is rescheduled due to dependency. [ 1054.819019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.819019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.819019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.819019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.820446] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.820446] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.820446] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.820446] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.820446] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.851139] env[71140]: INFO networking_nsxv3.common.synchronization [req-ea8e8764-5a4a-4871-a843-daaa3420cccc req-3fd3dade-7078-49fc-a9a7-e620b32ec5e6 tempest-AttachInterfacesUnderV243Test-701512252 tempest-AttachInterfacesUnderV243Test-701512252-project-member] Enqueued Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_members [ 1054.851750] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_members [ 1054.852192] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-77acb82c-557e-4c76-a0f0-8f86422bacf5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.852327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.852398] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.852674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.853181] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.853313] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.853313] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.853508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.853508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.853607] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.945934] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 in Status: SUCCESS [ 1054.946259] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.946490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.946777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.947060] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.947232] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.947337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.947569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.947686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.947816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.947954] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8623c530-dbd9-4cff-983a-f2df2ac9ad58',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.322701] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.329221] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-336 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.329488] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-336" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.329605] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-336" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.329971] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-336" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.330311] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.330477] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.330595] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.330879] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.331059] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.331262] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1055.332028] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1055.332028] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1055.332028] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1055.332028] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1055.332028] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1055.332028] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1055.351433] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1055.351611] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1055.351863] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1055.351949] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-336" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.352286] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-583e25b2-78f9-4229-876f-6e37c2a139c8 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.353038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.353038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.353038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.353264] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('583e25b2-78f9-4229-876f-6e37c2a139c8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.359338] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.359470] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.359543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.359744] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.359834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.360038] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.360139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.360203] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.360458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.360583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.360583] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 already deleted. [ 1055.360710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.451534] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8623c530-dbd9-4cff-983a-f2df2ac9ad58',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.759111] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 in Status: SUCCESS [ 1055.759409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.826979] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.855480] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.855790] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.855880] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.856317] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.856524] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.856773] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 583e25b2-78f9-4229-876f-6e37c2a139c8 not found, creating... [ 1055.857155] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.857338] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.857466] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.857721] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.857930] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.858438] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.858660] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.858918] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.859036] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.859316] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.859504] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 583e25b2-78f9-4229-876f-6e37c2a139c8 is going to be created. [ 1055.880678] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.880993] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.881097] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.881466] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.881715] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.882087] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.955027] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8623c530-dbd9-4cff-983a-f2df2ac9ad58: rpc.has_security_group_logging(os_id): False [ 1055.981505] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.981691] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.981691] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.981968] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.982155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.982538] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.982678] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.982750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.983164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.983164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.983311] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 is going to be created. [ 1056.066299] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.066544] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.066544] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.066777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.067273] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.085179] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 in Status: IN_PROGRESS for 2s [ 1056.330749] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.331081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.331197] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.331449] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.331575] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.331687] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 1056.361074] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.361236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.361306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.361531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.361671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.369734] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 1056.801180] env[71140]: INFO networking_nsxv3.common.synchronization [req-ea8e8764-5a4a-4871-a843-daaa3420cccc req-b9b45834-c4f2-4121-b7b9-7c2222349c12 service nova] Enqueued Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_rules [ 1056.801180] env[71140]: INFO networking_nsxv3.common.synchronization [req-ea8e8764-5a4a-4871-a843-daaa3420cccc req-b9b45834-c4f2-4121-b7b9-7c2222349c12 service nova] Enqueued Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_members [ 1056.801180] env[71140]: INFO networking_nsxv3.common.synchronization [req-ea8e8764-5a4a-4871-a843-daaa3420cccc req-b9b45834-c4f2-4121-b7b9-7c2222349c12 service nova] Enqueued Resource ID: 583e25b2-78f9-4229-876f-6e37c2a139c8 with Priority: HIGHEST for action port [ 1056.801180] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_rules [ 1056.801180] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_members [ 1056.801180] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583e25b2-78f9-4229-876f-6e37c2a139c8 with Priority: HIGHEST for action port [ 1056.802593] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77acb82c-557e-4c76-a0f0-8f86422bacf5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.803154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.804919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.804919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.804919] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.805949] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-77acb82c-557e-4c76-a0f0-8f86422bacf5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.806273] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.806491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.807376] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.808295] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.808295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.808295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.808849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.808849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.808849] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.812895] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-583e25b2-78f9-4229-876f-6e37c2a139c8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.813038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.813121] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.813317] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.813401] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('583e25b2-78f9-4229-876f-6e37c2a139c8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.292111] env[71140]: INFO networking_nsxv3.common.synchronization [req-289ce2aa-f4e0-48af-a7f9-54efe3a2f33c req-4c4b2a81-15bd-43bb-ac92-1bb8b884edee tempest-ServerRescueNegativeTestJSON-432250818 tempest-ServerRescueNegativeTestJSON-432250818-project-member] Enqueued Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGHEST for action security_group_members [ 1057.292649] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGHEST for action security_group_members [ 1057.292989] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.293197] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.293197] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.293387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.293536] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.293628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.293684] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.293826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.293909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.294009] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.307901] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-77acb82c-557e-4c76-a0f0-8f86422bacf5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.308074] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.315694] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 583e25b2-78f9-4229-876f-6e37c2a139c8 with status ACTIVE [ 1057.315967] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.316129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.316207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.316445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.316576] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.316816] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.316938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.317013] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.317200] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.317289] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.317525] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.317642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.317707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.317875] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.317956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.318065] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 583e25b2-78f9-4229-876f-6e37c2a139c8 is going to be updated. [ 1057.323644] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.345616] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.345791] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.345873] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.346281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.346368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.346516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.796257] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.827600] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.097520] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 in Status: SUCCESS [ 1058.097858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.285501] env[71140]: INFO networking_nsxv3.common.synchronization [req-f7d359d9-45e0-49df-8d5c-ef1a5793187f req-69960579-3d9d-432b-806d-c06bbf94df6d tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1058.286032] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1058.286341] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.286464] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.286531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.286741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.286889] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.286985] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.287179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.287346] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.287509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.287603] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.297979] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.330466] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.331057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.331134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.331358] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.331474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.331573] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 is going to be created. [ 1058.353675] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.353821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.353911] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.354138] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.354339] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.363084] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 in Status: UNINITIALIZED for 2s [ 1058.378038] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 1058.378038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.378038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.378369] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.378369] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.378593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.378593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.380015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.380015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.380015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.380015] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.617887] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-941 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.618450] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.618688] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.619299] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.619894] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.620453] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.620614] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.620940] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.621116] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.621382] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1058.621522] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1058.621691] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1058.621933] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1058.622143] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1058.622298] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1058.622477] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1058.641092] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1058.641324] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1058.641552] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1058.643035] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.643035] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-f68ca30e-c765-4e4c-8d98-1d9aa921d5bc taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.643035] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-f68ca30e-c765-4e4c-8d98-1d9aa921d5bc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.643035] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-f68ca30e-c765-4e4c-8d98-1d9aa921d5bc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.643319] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-f68ca30e-c765-4e4c-8d98-1d9aa921d5bc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.643319] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f68ca30e-c765-4e4c-8d98-1d9aa921d5bc',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.790031] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.790229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.790229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.790420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.790593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.790810] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.790915] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.790980] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.791140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.791253] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.791361] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be updated. [ 1058.800391] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.800618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.800726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.801056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.801656] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.801656] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 is going to be updated. [ 1058.838336] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.838496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.838574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.838894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.838958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.848803] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: IN_PROGRESS for 2s [ 1058.851130] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.851130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.851130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.851398] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.851398] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.859314] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 in Status: IN_PROGRESS for 2s [ 1058.882533] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.882768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.882768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.882992] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.883187] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.883293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.883359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.883519] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.883607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.883698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.883913] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.884102] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.884102] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.884198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.884277] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.884349] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.884434] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.884593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.884705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.884805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.884899] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.146437] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.146739] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.146966] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.147274] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.147477] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.147786] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port f68ca30e-c765-4e4c-8d98-1d9aa921d5bc not found, creating... [ 1059.148146] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.148400] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.148546] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.148777] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.148926] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.149342] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.149589] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.149647] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.149858] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.150034] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.150190] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: f68ca30e-c765-4e4c-8d98-1d9aa921d5bc is going to be created. [ 1059.169113] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.169370] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.169506] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.169889] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.170153] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.170398] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-f68ca30e-c765-4e4c-8d98-1d9aa921d5bc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.387459] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2975c43-5d19-4643-8076-5d24f0ea84c6: rpc.has_security_group_logging(os_id): False [ 1059.406539] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.406984] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.407086] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.407302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.407408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.407672] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.407796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.407870] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.408103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.408208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.408462] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.408599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.408681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.408865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.408951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.409179] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.409301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.409394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.409556] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.409635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.409723] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 1059.469289] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.469451] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.469520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.469824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.470016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.492131] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 1059.878645] env[71140]: INFO networking_nsxv3.common.synchronization [req-f7d359d9-45e0-49df-8d5c-ef1a5793187f req-be3ea704-3943-4ecf-9d61-e713ffee1910 service nova] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_rules [ 1059.878825] env[71140]: INFO networking_nsxv3.common.synchronization [req-f7d359d9-45e0-49df-8d5c-ef1a5793187f req-be3ea704-3943-4ecf-9d61-e713ffee1910 service nova] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1059.878969] env[71140]: INFO networking_nsxv3.common.synchronization [req-f7d359d9-45e0-49df-8d5c-ef1a5793187f req-be3ea704-3943-4ecf-9d61-e713ffee1910 service nova] Enqueued Resource ID: f68ca30e-c765-4e4c-8d98-1d9aa921d5bc with Priority: HIGHEST for action port [ 1059.879588] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_rules [ 1059.879727] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1059.879838] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f68ca30e-c765-4e4c-8d98-1d9aa921d5bc with Priority: HIGHEST for action port [ 1059.880684] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.882125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.882125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.882125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.882125] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.882802] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.883429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.883429] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-f68ca30e-c765-4e4c-8d98-1d9aa921d5bc taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.883429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f68ca30e-c765-4e4c-8d98-1d9aa921d5bc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.883429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f68ca30e-c765-4e4c-8d98-1d9aa921d5bc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.883429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f68ca30e-c765-4e4c-8d98-1d9aa921d5bc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.883753] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f68ca30e-c765-4e4c-8d98-1d9aa921d5bc',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.373475] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 in Status: SUCCESS [ 1060.373628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.373805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.374140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.374281] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.374393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.374489] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.374683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.374733] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.374818] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.374895] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.387571] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.387571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.387571] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f68ca30e-c765-4e4c-8d98-1d9aa921d5bc with status ACTIVE [ 1060.387571] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.387571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.387571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.387571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.387571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.387571] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.387571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.387571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.388524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.388524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.388524] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.388524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.388524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.388524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.388836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.388836] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f68ca30e-c765-4e4c-8d98-1d9aa921d5bc is going to be updated. [ 1060.407569] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.407723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.407774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.407973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.408124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.408313] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f68ca30e-c765-4e4c-8d98-1d9aa921d5bc" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.857714] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 1060.857896] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 deletion is rescheduled due to dependency. [ 1060.858015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.858173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.858429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.858677] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.858781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.858781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.858921] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.858997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.859102] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.867094] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 in Status: SUCCESS [ 1060.867303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.879137] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.362124] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.383788] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77acb82c-557e-4c76-a0f0-8f86422bacf5: rpc.has_security_group_logging(os_id): False [ 1061.399145] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.399994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.399994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.399994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.399994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.399994] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.400361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.400361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.400361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.400361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.400651] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 is going to be created. [ 1061.459096] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.459333] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.459514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.459674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.459891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.474939] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 in Status: IN_PROGRESS for 2s [ 1061.505795] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 1061.506156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.864421] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.367181] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.367427] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.367427] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.367799] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.368042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.368042] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be updated. [ 1062.396349] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.396534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.398040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.398040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.398040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.406103] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: IN_PROGRESS for 2s [ 1062.633965] env[71140]: INFO networking_nsxv3.common.synchronization [req-56f2fc3c-ffca-4502-bd9f-48c0f94ec6b3 req-169f63e5-fe26-4eca-b706-b8d76dd4aeeb tempest-ServersTestJSON-1092316267 tempest-ServersTestJSON-1092316267-project-member] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1062.634485] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1062.634783] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.634908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.634977] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.636673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.637052] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.637246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.637422] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.637637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.637783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.637820] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.973146] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-452 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.973349] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.973479] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.973757] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.974934] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.975210] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.975359] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.975724] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.975955] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.976339] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1062.976566] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.976770] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.976967] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.977159] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1062.977327] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.977530] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.995750] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.996010] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1062.996249] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.996507] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.996963] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-dcd29db5-21f2-4b0c-871b-6c829036b56b taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.997260] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-dcd29db5-21f2-4b0c-871b-6c829036b56b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.997439] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-dcd29db5-21f2-4b0c-871b-6c829036b56b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.997895] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-dcd29db5-21f2-4b0c-871b-6c829036b56b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.998138] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcd29db5-21f2-4b0c-871b-6c829036b56b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.142058] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.487593] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 in Status: SUCCESS [ 1063.487855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.501448] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.501448] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.501616] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.501783] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.502555] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.502555] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port dcd29db5-21f2-4b0c-871b-6c829036b56b not found, creating... [ 1063.502555] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.502788] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.502839] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.503073] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.503242] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.503551] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.503746] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.503898] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.504137] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.504295] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.504457] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: dcd29db5-21f2-4b0c-871b-6c829036b56b is going to be created. [ 1063.524438] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.524749] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.524902] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.525263] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.525457] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.525698] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-dcd29db5-21f2-4b0c-871b-6c829036b56b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.648384] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.149631] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.149727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.149765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.149996] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.150113] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.150216] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1064.177915] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.177915] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.177915] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.178197] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.178252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.193646] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1064.238672] env[71140]: INFO networking_nsxv3.common.synchronization [req-56f2fc3c-ffca-4502-bd9f-48c0f94ec6b3 req-380ba6e9-392b-47dc-9754-34bca8d31178 service nova] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_rules [ 1064.238780] env[71140]: INFO networking_nsxv3.common.synchronization [req-56f2fc3c-ffca-4502-bd9f-48c0f94ec6b3 req-380ba6e9-392b-47dc-9754-34bca8d31178 service nova] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1064.238870] env[71140]: INFO networking_nsxv3.common.synchronization [req-56f2fc3c-ffca-4502-bd9f-48c0f94ec6b3 req-380ba6e9-392b-47dc-9754-34bca8d31178 service nova] Enqueued Resource ID: dcd29db5-21f2-4b0c-871b-6c829036b56b with Priority: HIGHEST for action port [ 1064.239435] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_rules [ 1064.239618] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1064.239679] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcd29db5-21f2-4b0c-871b-6c829036b56b with Priority: HIGHEST for action port [ 1064.239959] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.244317] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.244412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.244646] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.244743] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.247285] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.247285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.247285] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcd29db5-21f2-4b0c-871b-6c829036b56b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.247285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcd29db5-21f2-4b0c-871b-6c829036b56b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.247285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcd29db5-21f2-4b0c-871b-6c829036b56b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.247285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcd29db5-21f2-4b0c-871b-6c829036b56b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.247285] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcd29db5-21f2-4b0c-871b-6c829036b56b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.417747] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 1064.417747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.417747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.417747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.417747] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.417747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.417747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.417747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.417747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.417747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.417747] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.749469] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.749469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.753888] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dcd29db5-21f2-4b0c-871b-6c829036b56b with status ACTIVE [ 1064.754177] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.754724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.754724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.754724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.754947] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.754947] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.755151] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.755151] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.755334] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.755458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.756025] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.756025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.756025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.756025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.756340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.756340] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dcd29db5-21f2-4b0c-871b-6c829036b56b is going to be updated. [ 1064.778075] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.778075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.778075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.778075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.778380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.778532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcd29db5-21f2-4b0c-871b-6c829036b56b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.920216] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.920414] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.920414] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.920926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.920926] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.920926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.920926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.921204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.921204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.921283] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.921768] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.921933] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.922021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.922164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.922313] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.922401] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.922862] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.923201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.923285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.923567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.923567] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.980461] env[71140]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1064.980461] env[71140]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] NSXv3 Agent Agent loop - iteration:2 started [ 1065.427870] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7d76214-330f-43f9-a3bd-c36a084b6ab5: rpc.has_security_group_logging(os_id): False [ 1065.446024] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.446024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.446024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.446024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.446024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.446024] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.446024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.446024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.446024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.446024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.446024] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.446024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.446024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.446707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.446707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.446707] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.446964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.447167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.447454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.447645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.447855] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be updated. [ 1065.513839] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.513839] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.513839] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.513839] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.513839] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.529919] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: IN_PROGRESS for 2s [ 1066.118195] env[71140]: INFO networking_nsxv3.common.synchronization [None req-16298752-0089-4647-b442-6ba246d5ce63 tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1066.118195] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1066.118195] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.118624] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.118624] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.118624] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.118877] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.118877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.119041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.119100] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.119156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.119414] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.203733] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1066.203953] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.204480] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.204708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.204905] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.205064] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.205143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.205317] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.205416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.205513] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.620921] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.708690] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.793703] env[71140]: INFO networking_nsxv3.common.synchronization [req-90a345cf-d2d7-4c49-890f-c0976fba4c59 req-97e85d23-f469-45fc-89ff-8f106cf7d244 tempest-ServerDiskConfigTestJSON-63292790 tempest-ServerDiskConfigTestJSON-63292790-project-member] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 1066.794255] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGHEST for action security_group_members [ 1066.795555] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.795555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.795555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.795555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.795555] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.795555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.795555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.795555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.795555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.795981] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.123167] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.215113] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.298151] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.298253] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.298253] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.298570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.299645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.299645] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.299645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.299645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.299645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.299645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.299645] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be updated. [ 1067.324608] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.324767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.324767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.324965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.325128] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.332615] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: IN_PROGRESS for 2s [ 1067.541425] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 1067.541425] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.626353] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.626544] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.626653] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.626899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.626998] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.627102] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be updated. [ 1067.654673] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.654673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.655040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.655040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.655235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.663887] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: IN_PROGRESS for 2s [ 1067.717108] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.717108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.717108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.717459] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.717459] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.717459] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1067.745921] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.746089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.746171] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.746385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.746528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.754361] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1067.979238] env[71140]: INFO networking_nsxv3.common.synchronization [req-722731f3-191a-48e1-ac50-bfabeb01c95b req-fa690b6f-af8e-48ee-9672-e750f4d7ee36 tempest-ServerGroupTestJSON-31308556 tempest-ServerGroupTestJSON-31308556-project-member] Enqueued Resource ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 with Priority: HIGHEST for action security_group_members [ 1067.979238] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 with Priority: HIGHEST for action security_group_members [ 1067.979238] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-89ab7a19-079c-4b53-bee2-637fae5e2fc1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.979238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.979238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.979238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.979238] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.979800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.980019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.980418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.980620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.981144] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89ab7a19-079c-4b53-bee2-637fae5e2fc1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.266816] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-957 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.267158] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-957" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.267224] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-957" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.267517] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-957" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.267790] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.267950] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.268200] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.268518] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.268714] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.268961] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1068.269117] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1068.269425] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1068.269425] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1068.269664] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1068.269802] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1068.269966] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1068.288073] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1068.288255] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1068.288447] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1068.288647] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-957" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.288955] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-41f93fed-957a-451d-80b6-23561409b5fa taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.289141] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-41f93fed-957a-451d-80b6-23561409b5fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.289264] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-41f93fed-957a-451d-80b6-23561409b5fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.289663] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-41f93fed-957a-451d-80b6-23561409b5fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.289806] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41f93fed-957a-451d-80b6-23561409b5fa',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.373385] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-941 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.373583] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.373708] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.373986] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.374266] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.374466] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.374596] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.374817] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.374970] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.375189] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1068.375315] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1068.375465] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1068.375585] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1068.375703] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1068.375820] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1068.375957] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1068.454588] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1068.454748] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.079 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1068.454874] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1068.455049] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.455380] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-edaac09d-eef7-4ff4-baae-a13d71e6a87b taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.455558] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-edaac09d-eef7-4ff4-baae-a13d71e6a87b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.455683] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-edaac09d-eef7-4ff4-baae-a13d71e6a87b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.456031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-edaac09d-eef7-4ff4-baae-a13d71e6a87b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.456180] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edaac09d-eef7-4ff4-baae-a13d71e6a87b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.484179] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.484365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.484365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.484547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.484636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.484821] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.484914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.484971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.485132] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.485208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.485290] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 already deleted. [ 1068.485368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.792358] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.792650] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.792819] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.793141] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.793323] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.793487] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 41f93fed-957a-451d-80b6-23561409b5fa not found, creating... [ 1068.793780] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.793937] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.794086] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.794332] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.794534] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.794956] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.795161] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.795287] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.795552] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.795742] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.795909] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 41f93fed-957a-451d-80b6-23561409b5fa is going to be created. [ 1068.815010] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.815269] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.815403] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.815716] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.815987] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.816262] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-41f93fed-957a-451d-80b6-23561409b5fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.959271] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.959602] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.959701] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.960041] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.960255] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.960438] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port edaac09d-eef7-4ff4-baae-a13d71e6a87b not found, creating... [ 1068.960814] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.961018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.961176] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.961494] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.961668] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.962122] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.962365] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.962554] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.962829] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.963047] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.963247] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: edaac09d-eef7-4ff4-baae-a13d71e6a87b is going to be created. [ 1068.984112] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.984346] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.984477] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.984791] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.985042] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.985290] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-edaac09d-eef7-4ff4-baae-a13d71e6a87b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.344488] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 in Status: SUCCESS [ 1069.344809] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 deletion is rescheduled due to dependency. [ 1069.344855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.524591] env[71140]: INFO networking_nsxv3.common.synchronization [req-722731f3-191a-48e1-ac50-bfabeb01c95b req-a374242b-763f-46fc-9352-5df82627ebcb service nova] Enqueued Resource ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 with Priority: HIGHEST for action security_group_rules [ 1069.524813] env[71140]: INFO networking_nsxv3.common.synchronization [req-722731f3-191a-48e1-ac50-bfabeb01c95b req-a374242b-763f-46fc-9352-5df82627ebcb service nova] Enqueued Resource ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 with Priority: HIGHEST for action security_group_members [ 1069.525045] env[71140]: INFO networking_nsxv3.common.synchronization [req-722731f3-191a-48e1-ac50-bfabeb01c95b req-a374242b-763f-46fc-9352-5df82627ebcb service nova] Enqueued Resource ID: 41f93fed-957a-451d-80b6-23561409b5fa with Priority: HIGHEST for action port [ 1069.525198] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 with Priority: HIGHEST for action security_group_rules [ 1069.525320] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 with Priority: HIGHEST for action security_group_members [ 1069.525417] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41f93fed-957a-451d-80b6-23561409b5fa with Priority: HIGHEST for action port [ 1069.526265] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89ab7a19-079c-4b53-bee2-637fae5e2fc1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.526590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.526590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.526801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.526885] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89ab7a19-079c-4b53-bee2-637fae5e2fc1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.527900] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-89ab7a19-079c-4b53-bee2-637fae5e2fc1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.528091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.528091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.528535] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.528713] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.528713] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.528852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.528904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.528960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.529056] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89ab7a19-079c-4b53-bee2-637fae5e2fc1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.529795] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-41f93fed-957a-451d-80b6-23561409b5fa taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.530361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41f93fed-957a-451d-80b6-23561409b5fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.530361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41f93fed-957a-451d-80b6-23561409b5fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.530532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41f93fed-957a-451d-80b6-23561409b5fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.530532] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41f93fed-957a-451d-80b6-23561409b5fa',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.601265] env[71140]: INFO networking_nsxv3.common.synchronization [req-a52df9b1-c823-4a12-a5ea-a98b1c85e3a6 req-2c2d90a0-1e1f-4613-be74-9119d1045206 service nova] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_rules [ 1069.601265] env[71140]: INFO networking_nsxv3.common.synchronization [req-a52df9b1-c823-4a12-a5ea-a98b1c85e3a6 req-2c2d90a0-1e1f-4613-be74-9119d1045206 service nova] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1069.601265] env[71140]: INFO networking_nsxv3.common.synchronization [req-a52df9b1-c823-4a12-a5ea-a98b1c85e3a6 req-2c2d90a0-1e1f-4613-be74-9119d1045206 service nova] Enqueued Resource ID: edaac09d-eef7-4ff4-baae-a13d71e6a87b with Priority: HIGHEST for action port [ 1069.601265] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_rules [ 1069.601265] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1069.601265] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edaac09d-eef7-4ff4-baae-a13d71e6a87b with Priority: HIGHEST for action port [ 1069.601265] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.601265] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.601265] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.601265] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.601265] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.602198] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.602582] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.602582] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-edaac09d-eef7-4ff4-baae-a13d71e6a87b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.602756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edaac09d-eef7-4ff4-baae-a13d71e6a87b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.602916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edaac09d-eef7-4ff4-baae-a13d71e6a87b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.603136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edaac09d-eef7-4ff4-baae-a13d71e6a87b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.603136] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edaac09d-eef7-4ff4-baae-a13d71e6a87b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.673904] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 1069.673904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.673904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.674199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.674415] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.674535] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.674605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.674769] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.675030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.675030] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.764905] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1069.765166] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.765338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.765845] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.766097] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.766240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.766332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.766539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.766625] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.766738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.766831] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.032284] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-89ab7a19-079c-4b53-bee2-637fae5e2fc1 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.032427] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.032721] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89ab7a19-079c-4b53-bee2-637fae5e2fc1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.034301] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41f93fed-957a-451d-80b6-23561409b5fa with status ACTIVE [ 1070.034533] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.034677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.034767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.035011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.035142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.035347] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.035534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.035534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.035710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.035805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.035986] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.036090] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.036149] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.036290] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.036391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.036480] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41f93fed-957a-451d-80b6-23561409b5fa is going to be updated. [ 1070.056164] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.056455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.056572] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.056948] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.057125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.057297] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41f93fed-957a-451d-80b6-23561409b5fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.104853] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.105054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.105202] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port edaac09d-eef7-4ff4-baae-a13d71e6a87b with status ACTIVE [ 1070.105374] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.105550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.105616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.105837] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.105940] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.106133] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.106234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.106303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.106573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.106696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.106906] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.107038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.107090] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.107244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.107319] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.107406] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: edaac09d-eef7-4ff4-baae-a13d71e6a87b is going to be updated. [ 1070.130065] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.130287] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.130356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.130585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.130661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.130854] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edaac09d-eef7-4ff4-baae-a13d71e6a87b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.177397] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.269708] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.269708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.269859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.269960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.270577] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.270577] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.270577] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.270577] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.270577] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.270577] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.271157] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.271157] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.271157] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.271157] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.271391] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.271391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.271391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.271592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.271592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.271592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.271747] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.542271] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89ab7a19-079c-4b53-bee2-637fae5e2fc1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.680036] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.774032] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e8717ad-052a-4a86-b223-df55dd81c619: rpc.has_security_group_logging(os_id): False [ 1070.791308] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.791534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.791534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.791750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.791847] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.792102] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.792207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.792267] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.792431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.792514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.792779] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.793049] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.793049] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.793406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.793406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.793548] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.793548] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.793703] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.793763] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.793820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.793908] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1070.867516] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.867728] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.867813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.868190] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.868372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.882722] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1071.042292] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.042426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.042503] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.042732] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.042819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.042922] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 is going to be created. [ 1071.089680] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.089829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.089896] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.090143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.090322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.105661] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 in Status: UNINITIALIZED for 2s [ 1071.184856] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.184856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.185071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.185248] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.185327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.185456] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be updated. [ 1071.241245] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.241413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.241478] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.241697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.241843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.249564] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: IN_PROGRESS for 2s [ 1072.895093] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1072.895523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.124057] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 in Status: SUCCESS [ 1073.124057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.124057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.124583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.124824] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.125364] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.125473] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.125677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.125804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.126239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.126418] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89ab7a19-079c-4b53-bee2-637fae5e2fc1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.261361] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 1073.261361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.261361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.261361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.261361] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.261361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.261361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.261361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.261361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.261361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.261361] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.629424] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-89ab7a19-079c-4b53-bee2-637fae5e2fc1 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.629424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.629424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.629718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.629718] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.629832] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.629886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.630066] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.630168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.630288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.630404] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-89ab7a19-079c-4b53-bee2-637fae5e2fc1 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.630504] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.630622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.630747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.630927] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.631025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.631068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.631311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.631311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.631423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.631461] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89ab7a19-079c-4b53-bee2-637fae5e2fc1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.769272] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.770669] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.770669] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.770669] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.770903] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.770903] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.771112] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.771209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.771322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.771490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.771638] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.771687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.771756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.771926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.772302] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.772302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.772302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.772432] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.772469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.772545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.772646] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.134681] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89ab7a19-079c-4b53-bee2-637fae5e2fc1: rpc.has_security_group_logging(os_id): False [ 1074.153876] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.154053] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.154349] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.154417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.154561] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.154940] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.154940] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.155115] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.155238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.155346] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.155567] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.155714] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.155796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.156385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.156385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.156385] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.156385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.156712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.156712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.156712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.156833] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 is going to be created. [ 1074.238984] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.239198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.239248] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.239442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.239628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.254354] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 in Status: IN_PROGRESS for 2s [ 1074.275860] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7d76214-330f-43f9-a3bd-c36a084b6ab5: rpc.has_security_group_logging(os_id): False [ 1074.304032] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.304032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.304032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.304032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.304032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.304032] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.304032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.304032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.304032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.304032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.304032] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.304864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.304864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.304864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.304864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.304864] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.304864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.304864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.304864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.304864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.305610] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be updated. [ 1074.419278] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.419278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.419278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.419469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.419801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.443585] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: IN_PROGRESS for 2s [ 1074.600985] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1074.601208] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1075.785193] env[71140]: INFO networking_nsxv3.common.synchronization [None req-73eb75bb-4907-4cf0-80b1-81d83918cf34 tempest-ServerActionsTestJSON-2079743708 tempest-ServerActionsTestJSON-2079743708-project-member] Enqueued Resource ID: 638f5992-652b-4deb-89c8-b409cb49bf0a with Priority: HIGHEST for action security_group_rules [ 1075.785193] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638f5992-652b-4deb-89c8-b409cb49bf0a with Priority: HIGHEST for action security_group_rules [ 1075.785193] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-638f5992-652b-4deb-89c8-b409cb49bf0a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.785193] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.785193] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.785193] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.785193] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('638f5992-652b-4deb-89c8-b409cb49bf0a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.946843] env[71140]: INFO networking_nsxv3.common.synchronization [req-854041fb-9cb7-424f-afb2-a232058ac004 req-15164d68-dc09-41d2-9112-8d03abb77f5a tempest-ServerRescueNegativeTestJSON-432250818 tempest-ServerRescueNegativeTestJSON-432250818-project-member] Enqueued Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGHEST for action security_group_members [ 1075.948093] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGHEST for action security_group_members [ 1075.948093] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.948093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.948093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.948658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.948883] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.949034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.949130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.949332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.949455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.949600] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.230111] env[71140]: INFO networking_nsxv3.common.synchronization [None req-3aed991b-f9a9-4111-8291-d5b6dba3cb0a tempest-ServerActionsTestJSON-2079743708 tempest-ServerActionsTestJSON-2079743708-project-member] Enqueued Resource ID: 638f5992-652b-4deb-89c8-b409cb49bf0a with Priority: HIGHEST for action security_group_rules [ 1076.230629] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638f5992-652b-4deb-89c8-b409cb49bf0a with Priority: HIGHEST for action security_group_rules [ 1076.231705] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-638f5992-652b-4deb-89c8-b409cb49bf0a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.231833] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.253010] env[71140]: INFO networking_nsxv3.common.synchronization [req-178c0e22-c2cf-420d-9bb9-5035f063ac22 req-da60ffc7-2ea6-4ad8-b3e0-bf9671f4119e tempest-DeleteServersTestJSON-1199867382 tempest-DeleteServersTestJSON-1199867382-project-member] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1076.253564] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1076.253881] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.258590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.258590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.258590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.258590] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.258590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.258590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.258590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.258590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.258590] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.271978] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 in Status: SUCCESS [ 1076.271978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.291148] env[71140]: INFO networking_nsxv3.common.synchronization [None req-5583979d-cf59-404a-b2b2-6de2d24db55d None None] Enqueued Resource ID: d8c04344-625e-4590-aa38-c084e7e2c820 with Priority: HIGHEST for action port [ 1076.291990] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8c04344-625e-4590-aa38-c084e7e2c820 with Priority: HIGHEST for action port [ 1076.293231] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8c04344-625e-4590-aa38-c084e7e2c820 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.293231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8c04344-625e-4590-aa38-c084e7e2c820" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.293408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8c04344-625e-4590-aa38-c084e7e2c820" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.293516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8c04344-625e-4590-aa38-c084e7e2c820" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.293691] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8c04344-625e-4590-aa38-c084e7e2c820',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.310169] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.310338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.310413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.310617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.310711] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.310806] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 638f5992-652b-4deb-89c8-b409cb49bf0a already deleted. [ 1076.310894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.311498] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.311605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.311660] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('638f5992-652b-4deb-89c8-b409cb49bf0a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.451545] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.452069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.452238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.452479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.452620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.452855] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.453029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.453130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.453324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.453427] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.453549] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 is going to be updated. [ 1076.459010] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 1076.459269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.477348] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.477516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.477588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.477834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.478042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.488355] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 in Status: IN_PROGRESS for 2s [ 1076.736352] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-351 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.736854] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.736943] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.737218] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.737506] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.737675] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.738150] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.738478] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.738815] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.739399] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1076.739489] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1076.739584] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1076.739679] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1076.739799] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1076.739957] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1076.740074] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1076.762605] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.762605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.762605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.762928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.762928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.764312] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.764312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.764312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.764312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.764312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.764312] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be updated. [ 1076.768140] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1076.768140] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1076.768140] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1076.768288] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.768727] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-1febd2ce-d39f-4c9f-ae8e-63f19228b49f taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.768955] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-1febd2ce-d39f-4c9f-ae8e-63f19228b49f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.770023] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-1febd2ce-d39f-4c9f-ae8e-63f19228b49f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.771236] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-1febd2ce-d39f-4c9f-ae8e-63f19228b49f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.771236] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1febd2ce-d39f-4c9f-ae8e-63f19228b49f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.796944] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.796944] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.796944] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.799249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.799249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.799434] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8c04344-625e-4590-aa38-c084e7e2c820 [ 1076.799782] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.801433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.801433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.801433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.801433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.801433] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8c04344-625e-4590-aa38-c084e7e2c820 already deleted. [ 1076.801433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8c04344-625e-4590-aa38-c084e7e2c820" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.826850] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 1076.853536] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.853536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.853536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.853536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.853536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.853536] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 638f5992-652b-4deb-89c8-b409cb49bf0a already deleted. [ 1076.853536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.921982] env[71140]: INFO networking_nsxv3.common.synchronization [req-ff330e95-4fa5-4ae5-9c80-1c09e1d4c02c req-00caaa5a-28b2-44a4-a29c-43148af5ee6d tempest-ServerActionsTestOtherA-289074452 tempest-ServerActionsTestOtherA-289074452-project-member] Enqueued Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGHEST for action security_group_members [ 1076.922550] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGHEST for action security_group_members [ 1076.922867] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7015c2-a058-452d-bfd5-0575d4a237f8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.922989] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.924169] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.924406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.924584] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.924825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.924825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.924972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.925131] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.925131] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.057726] env[71140]: INFO networking_nsxv3.common.synchronization [req-86d3dded-9db4-4778-a530-ff036b37e92a req-ac5236fb-8622-4c40-91c7-8ca60fdaaa91 tempest-ServersTestJSON-1092316267 tempest-ServersTestJSON-1092316267-project-member] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1077.058364] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1077.058604] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.058755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.058836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.059094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.059268] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.059365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.059444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.059876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.059876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.059876] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.274894] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.277432] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.277432] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.277432] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.277432] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.277432] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 1febd2ce-d39f-4c9f-ae8e-63f19228b49f not found, creating... [ 1077.278624] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.279414] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.279713] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.280121] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.283033] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.283033] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.283033] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.283033] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.283033] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.283033] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.283033] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 1febd2ce-d39f-4c9f-ae8e-63f19228b49f is going to be created. [ 1077.304210] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.304210] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.304210] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.304210] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.304210] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.304210] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-1febd2ce-d39f-4c9f-ae8e-63f19228b49f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.430400] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.430400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.430400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.430400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.430400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.430400] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.430400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.430400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.430400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.430400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.430400] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 is going to be updated. [ 1077.460376] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.460376] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.460376] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.460376] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.460376] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.469485] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 in Status: IN_PROGRESS for 2s [ 1077.563530] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.067097] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.162119] env[71140]: INFO networking_nsxv3.common.synchronization [req-178c0e22-c2cf-420d-9bb9-5035f063ac22 req-0c860ef2-1158-4cb0-861f-51cc05c67c68 service nova] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_rules [ 1078.162269] env[71140]: INFO networking_nsxv3.common.synchronization [req-178c0e22-c2cf-420d-9bb9-5035f063ac22 req-0c860ef2-1158-4cb0-861f-51cc05c67c68 service nova] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1078.162415] env[71140]: INFO networking_nsxv3.common.synchronization [req-178c0e22-c2cf-420d-9bb9-5035f063ac22 req-0c860ef2-1158-4cb0-861f-51cc05c67c68 service nova] Enqueued Resource ID: 1febd2ce-d39f-4c9f-ae8e-63f19228b49f with Priority: HIGHEST for action port [ 1078.165441] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_rules [ 1078.165563] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1078.165838] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1febd2ce-d39f-4c9f-ae8e-63f19228b49f with Priority: HIGHEST for action port [ 1078.167371] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.167371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.167371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.167371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.167371] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.169102] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.169763] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.171774] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-1febd2ce-d39f-4c9f-ae8e-63f19228b49f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.171774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1febd2ce-d39f-4c9f-ae8e-63f19228b49f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.171774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1febd2ce-d39f-4c9f-ae8e-63f19228b49f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.171774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1febd2ce-d39f-4c9f-ae8e-63f19228b49f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.171774] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1febd2ce-d39f-4c9f-ae8e-63f19228b49f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.344129] env[71140]: INFO networking_nsxv3.common.synchronization [None req-cfc4326d-f969-4c7f-a257-7642ccf4129c None None] Enqueued Resource ID: cdf7747e-c1bd-472e-98d5-2ece4c1d0009 with Priority: HIGHEST for action port [ 1078.344793] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf7747e-c1bd-472e-98d5-2ece4c1d0009 with Priority: HIGHEST for action port [ 1078.345581] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdf7747e-c1bd-472e-98d5-2ece4c1d0009 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.345581] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdf7747e-c1bd-472e-98d5-2ece4c1d0009" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.345581] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdf7747e-c1bd-472e-98d5-2ece4c1d0009" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.345769] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdf7747e-c1bd-472e-98d5-2ece4c1d0009" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.345963] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdf7747e-c1bd-472e-98d5-2ece4c1d0009',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.497597] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 in Status: SUCCESS [ 1078.497597] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 deletion is rescheduled due to dependency. [ 1078.497597] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.571045] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.571876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.572078] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.572394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.572575] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.572851] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1078.598921] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.599388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.599388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.599504] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.599687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.608094] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1078.672639] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.672788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.673010] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1febd2ce-d39f-4c9f-ae8e-63f19228b49f with status ACTIVE [ 1078.673194] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.673307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.673373] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.673628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.673834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.674494] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.674494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.674494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.674494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.674494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.674494] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.674802] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.674802] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.674802] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.674868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.674895] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1febd2ce-d39f-4c9f-ae8e-63f19228b49f is going to be updated. [ 1078.699146] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.699146] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.699439] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.699472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.699629] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.699806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1febd2ce-d39f-4c9f-ae8e-63f19228b49f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.848804] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 1078.849038] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 deletion is rescheduled due to dependency. [ 1078.849160] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.849401] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdf7747e-c1bd-472e-98d5-2ece4c1d0009 [ 1078.849667] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.849823] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.849882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.850097] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.850185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.850274] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdf7747e-c1bd-472e-98d5-2ece4c1d0009 already deleted. [ 1078.850356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdf7747e-c1bd-472e-98d5-2ece4c1d0009" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.850482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.850719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.850882] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.851015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.851090] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.851235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.851311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.851405] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.354410] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.479704] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 in Status: SUCCESS [ 1079.479704] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 deletion is rescheduled due to dependency. [ 1079.479704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.859636] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.366163] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.366564] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.366564] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.366759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.366918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.367083] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be updated. [ 1080.397158] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.397158] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.397158] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.398342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.398639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.408541] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 1080.617916] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1080.619333] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.620183] env[71140]: INFO networking_nsxv3.common.synchronization [req-450b058b-fbf4-4dfe-a0a5-2980bd08a534 req-5c340e69-8728-4ef0-9a34-070b73af56d1 tempest-ServerGroupTestJSON-31308556 tempest-ServerGroupTestJSON-31308556-project-member] Enqueued Resource ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 with Priority: HIGHEST for action security_group_members [ 1081.620732] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 with Priority: HIGHEST for action security_group_members [ 1081.622356] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-89ab7a19-079c-4b53-bee2-637fae5e2fc1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.622356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.622356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.622356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.622356] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.622568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.622568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.622640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.622742] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.622836] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89ab7a19-079c-4b53-bee2-637fae5e2fc1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.127318] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.127532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.127650] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.127846] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.127957] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.128573] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.128573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.128573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.128573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.128773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.128773] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 is going to be updated. [ 1082.160242] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.160418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.160463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.160661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.160793] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.170598] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 in Status: IN_PROGRESS for 2s [ 1082.418369] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 1082.418655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.418988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.419170] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.419451] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.419564] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.419604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.419872] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.420257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.420371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.420473] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.897131] env[71140]: INFO networking_nsxv3.common.synchronization [req-b13fac4e-3780-45fd-a844-66608255cf52 req-8891e4d9-8cb9-4066-8210-522eb9a5bee8 tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1082.897536] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1082.897884] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.898096] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.898188] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.898391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.898785] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.898923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.899061] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.899293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.899389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.899485] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.923045] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.925397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.925397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.925397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.925397] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.925397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.925397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.926708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.926866] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.926910] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.927140] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.927340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.927340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.928033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.928033] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.928196] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.928196] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.928371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.928480] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.928592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.928782] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.404021] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.432472] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c549bd3-468a-4655-b709-3480ff374e11: rpc.has_security_group_logging(os_id): False [ 1083.454646] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.454816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.454891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.455135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.455230] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.455463] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.455563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.455625] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.455778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.455857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.456056] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.456151] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.456212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.456350] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.456421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.456596] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.456690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.457534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.459241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.459241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.459241] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be updated. [ 1083.515590] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.515590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.515755] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.516938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.516938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.528150] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 1083.906133] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.154762] env[71140]: INFO networking_nsxv3.common.synchronization [None req-55346428-d232-4b4d-bd25-f57abf5bb09d tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1084.155400] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1084.155709] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.155813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.178244] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 in Status: SUCCESS [ 1084.178424] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 deletion is rescheduled due to dependency. [ 1084.178886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.410759] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.410759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.410759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.410759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.410759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.410759] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be updated. [ 1084.450616] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.450616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.450616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.450616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.450785] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.462096] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: IN_PROGRESS for 2s [ 1085.541537] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 1085.541797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.472654] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 1086.472654] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.472654] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.473075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.473369] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.473565] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.473745] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.474057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.474237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.474423] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.801149] env[71140]: INFO networking_nsxv3.common.synchronization [req-abd67789-f3ab-4603-b4c8-f6b2b84148b1 req-50b47a2f-7153-4f78-903c-15b593962e26 tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a with Priority: HIGHEST for action security_group_members [ 1086.801836] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a with Priority: HIGHEST for action security_group_members [ 1086.802237] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-66227fe8-4a5f-47ba-add3-defc26d5bd6a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.802362] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.802431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.802631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.803211] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.803344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.803412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.803582] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.803672] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.803893] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66227fe8-4a5f-47ba-add3-defc26d5bd6a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.977308] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.977470] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.977548] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.978042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.978152] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.978359] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.978464] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.978526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.978696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.978771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.978877] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be updated. [ 1087.027757] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.027922] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.027997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.028234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.028374] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.037330] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: IN_PROGRESS for 2s [ 1087.056461] env[71140]: INFO networking_nsxv3.common.synchronization [req-1246b5ec-8c46-4288-9883-2545d6d69011 req-d738a6be-09bc-4f6a-86df-40daa43cc940 tempest-ListImageFiltersTestJSON-1329577525 tempest-ListImageFiltersTestJSON-1329577525-project-member] Enqueued Resource ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 with Priority: HIGHEST for action security_group_members [ 1087.057010] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 with Priority: HIGHEST for action security_group_members [ 1087.057313] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2548cfa1-8571-4be8-becb-2b5d950d7202 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.057505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.057505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.057706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.057867] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.057970] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.061440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.063147] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.063249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.063359] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.308225] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.308225] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.308225] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.308225] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.308465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.308549] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.308632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.308680] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.308854] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.308968] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.309012] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a is going to be updated. [ 1087.312792] env[71140]: INFO networking_nsxv3.common.synchronization [None req-3340a0bb-bf4a-43b2-90c1-295571d6e19a tempest-ServerActionsTestOtherA-289074452 tempest-ServerActionsTestOtherA-289074452-project-member] Enqueued Resource ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 with Priority: HIGHEST for action security_group_rules [ 1087.313638] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 with Priority: HIGHEST for action security_group_rules [ 1087.315051] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.315051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.315051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.315051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.315560] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84ef6ff9-0b29-4536-8581-a65788a9e9d0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.340838] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.340988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.341133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.341397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.341589] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.350942] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a in Status: IN_PROGRESS for 2s [ 1087.407820] env[71140]: INFO networking_nsxv3.common.synchronization [None req-8c30d27f-949f-4d9d-8437-e4a43f1ca3ef tempest-ServerActionsTestOtherA-289074452 tempest-ServerActionsTestOtherA-289074452-project-member] Enqueued Resource ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 with Priority: HIGHEST for action security_group_rules [ 1087.407820] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 with Priority: HIGHEST for action security_group_rules [ 1087.408198] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.408385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.567070] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.837304] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.838306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.838306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.838306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.838306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.838306] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 already deleted. [ 1087.838306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.838306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.838306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.838496] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84ef6ff9-0b29-4536-8581-a65788a9e9d0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.070221] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.361091] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.361091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.361091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.361091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.361091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.361091] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 already deleted. [ 1088.361091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.573045] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.573045] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.573045] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.573045] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.573045] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.573332] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 is going to be updated. [ 1088.599550] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.599820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.599820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.600105] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.600272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.609543] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 in Status: IN_PROGRESS for 2s [ 1088.717937] env[71140]: INFO networking_nsxv3.common.synchronization [req-ac661ad5-4df1-458f-9650-34fc5d87116a req-303eb083-ffb6-4add-a6ad-ce984e77ba37 tempest-ServerActionsTestJSON-2079743708 tempest-ServerActionsTestJSON-2079743708-project-member] Enqueued Resource ID: 638f5992-652b-4deb-89c8-b409cb49bf0a with Priority: HIGHEST for action security_group_members [ 1088.718524] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638f5992-652b-4deb-89c8-b409cb49bf0a with Priority: HIGHEST for action security_group_members [ 1088.718857] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-638f5992-652b-4deb-89c8-b409cb49bf0a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.718994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.719059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.719313] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.719470] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.719568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.719625] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.719772] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.719853] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.719965] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('638f5992-652b-4deb-89c8-b409cb49bf0a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.013045] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-168 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.013709] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-168" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.013709] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-168" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.013918] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-168" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.014100] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.014285] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.014420] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.014790] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.014790] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.015013] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.015134] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.015248] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.015360] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.015471] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.015581] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.015716] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.033956] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.034249] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1089.034391] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.034562] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-168" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.034871] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-ed273bd0-2d90-4253-bb98-0abbf1ecbf57 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.035060] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-ed273bd0-2d90-4253-bb98-0abbf1ecbf57" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.035300] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-ed273bd0-2d90-4253-bb98-0abbf1ecbf57" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.035640] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-ed273bd0-2d90-4253-bb98-0abbf1ecbf57" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.035785] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed273bd0-2d90-4253-bb98-0abbf1ecbf57',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.045957] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 1089.046416] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 deletion is rescheduled due to dependency. [ 1089.046416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.223871] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.224039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.224115] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.224338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.224431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.224793] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.224793] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.224793] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.224956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.224998] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.225076] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 638f5992-652b-4deb-89c8-b409cb49bf0a already deleted. [ 1089.225342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.345688] env[71140]: INFO networking_nsxv3.common.synchronization [req-b7e27a98-df5e-473e-a553-2ee82138b256 req-8711c6dd-de85-47b4-af2b-2bdb1b84ca1a tempest-AttachVolumeShelveTestJSON-926657130 tempest-AttachVolumeShelveTestJSON-926657130-project-member] Enqueued Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGHEST for action security_group_members [ 1089.346114] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGHEST for action security_group_members [ 1089.346422] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.346608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.346679] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.347043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.347788] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.347788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.347788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.347788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.347788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.347788] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.361088] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a in Status: SUCCESS [ 1089.361620] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66227fe8-4a5f-47ba-add3-defc26d5bd6a deletion is rescheduled due to dependency. [ 1089.361620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66227fe8-4a5f-47ba-add3-defc26d5bd6a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.539535] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.539804] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.539937] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.540259] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.540412] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.540570] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port ed273bd0-2d90-4253-bb98-0abbf1ecbf57 not found, creating... [ 1089.540843] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.541018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.541141] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.541358] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.541496] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.541779] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.541936] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.542781] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.544471] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.544624] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.544774] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: ed273bd0-2d90-4253-bb98-0abbf1ecbf57 is going to be created. [ 1089.565060] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.565285] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.565412] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.565805] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.565917] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.566162] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-ed273bd0-2d90-4253-bb98-0abbf1ecbf57" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.852391] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.852391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.852391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.852391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.852391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.852391] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.852391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.852391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.852391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.852391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.852391] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 is going to be updated. [ 1089.882787] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.883118] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.883291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.883582] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.883830] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.892365] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 in Status: IN_PROGRESS for 2s [ 1090.245222] env[71140]: INFO networking_nsxv3.common.synchronization [req-ac661ad5-4df1-458f-9650-34fc5d87116a req-4189a516-5602-4e32-afe7-992b43d09998 service nova] Enqueued Resource ID: 638f5992-652b-4deb-89c8-b409cb49bf0a with Priority: HIGHEST for action security_group_rules [ 1090.245222] env[71140]: INFO networking_nsxv3.common.synchronization [req-ac661ad5-4df1-458f-9650-34fc5d87116a req-4189a516-5602-4e32-afe7-992b43d09998 service nova] Enqueued Resource ID: 638f5992-652b-4deb-89c8-b409cb49bf0a with Priority: HIGHEST for action security_group_members [ 1090.245222] env[71140]: INFO networking_nsxv3.common.synchronization [req-ac661ad5-4df1-458f-9650-34fc5d87116a req-4189a516-5602-4e32-afe7-992b43d09998 service nova] Enqueued Resource ID: ed273bd0-2d90-4253-bb98-0abbf1ecbf57 with Priority: HIGHEST for action port [ 1090.245222] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638f5992-652b-4deb-89c8-b409cb49bf0a with Priority: HIGHEST for action security_group_rules [ 1090.245222] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638f5992-652b-4deb-89c8-b409cb49bf0a with Priority: HIGHEST for action security_group_members [ 1090.245222] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed273bd0-2d90-4253-bb98-0abbf1ecbf57 with Priority: HIGHEST for action port [ 1090.245222] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-638f5992-652b-4deb-89c8-b409cb49bf0a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.245222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.245222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.245222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.245222] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('638f5992-652b-4deb-89c8-b409cb49bf0a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.246922] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-638f5992-652b-4deb-89c8-b409cb49bf0a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.247179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.247359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.247634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.250022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.250022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.250022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.250022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.250022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.250022] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('638f5992-652b-4deb-89c8-b409cb49bf0a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.250022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed273bd0-2d90-4253-bb98-0abbf1ecbf57 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.250022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed273bd0-2d90-4253-bb98-0abbf1ecbf57" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.250022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed273bd0-2d90-4253-bb98-0abbf1ecbf57" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.250022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed273bd0-2d90-4253-bb98-0abbf1ecbf57" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.250022] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed273bd0-2d90-4253-bb98-0abbf1ecbf57',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.618466] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 in Status: SUCCESS [ 1090.618698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.755040] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-638f5992-652b-4deb-89c8-b409cb49bf0a taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.755040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.755040] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed273bd0-2d90-4253-bb98-0abbf1ecbf57 with status ACTIVE [ 1090.755040] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.755040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.755040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.755369] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.755369] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.755525] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.755636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.755699] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.755872] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.755954] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.756163] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.756258] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.756333] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.756481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.756559] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.756660] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed273bd0-2d90-4253-bb98-0abbf1ecbf57 is going to be updated. [ 1090.757858] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('638f5992-652b-4deb-89c8-b409cb49bf0a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.777111] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.777252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.777310] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.777890] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.777890] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.777890] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed273bd0-2d90-4253-bb98-0abbf1ecbf57" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.126813] env[71140]: INFO networking_nsxv3.common.synchronization [req-0d0d796f-237f-43c7-91c5-480cc173f563 req-8af1fb4d-8c99-4784-8507-6721ede8ea7e tempest-InstanceActionsNegativeTestJSON-813148999 tempest-InstanceActionsNegativeTestJSON-813148999-project-member] Enqueued Resource ID: d54f907b-db84-48ab-abc7-6edbf025059b with Priority: HIGHEST for action security_group_members [ 1091.127380] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d54f907b-db84-48ab-abc7-6edbf025059b with Priority: HIGHEST for action security_group_members [ 1091.127699] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d54f907b-db84-48ab-abc7-6edbf025059b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.127858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.127930] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.128254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.128421] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.128523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.128585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.128735] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.128823] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.128976] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d54f907b-db84-48ab-abc7-6edbf025059b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.262385] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('638f5992-652b-4deb-89c8-b409cb49bf0a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.408479] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-655 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.408773] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-655" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.408859] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-655" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.409204] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-655" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.409488] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.409654] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.409775] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.410010] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.410468] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.410571] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.410687] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.410800] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.410911] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.411039] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.411154] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.411315] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.429337] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.431017] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1091.431017] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.431017] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-655" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.431017] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-66d8cd75-d28d-42be-b886-cd2538f0ec63 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.431017] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-66d8cd75-d28d-42be-b886-cd2538f0ec63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.431017] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-66d8cd75-d28d-42be-b886-cd2538f0ec63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.431403] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-66d8cd75-d28d-42be-b886-cd2538f0ec63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.431644] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66d8cd75-d28d-42be-b886-cd2538f0ec63',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.497053] env[71140]: INFO networking_nsxv3.common.synchronization [req-9a2d3cbe-5876-4cb2-84cf-b895ade4287a req-2b0fc46e-e90f-4365-9a7f-f869a95ded62 tempest-DeleteServersTestJSON-1199867382 tempest-DeleteServersTestJSON-1199867382-project-member] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1091.497053] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1091.497053] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.497053] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.497053] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.497376] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.497616] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.497816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.497958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.498239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.498488] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.498668] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.632129] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.632129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.632229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.633393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.633393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.633393] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.633393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.633393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.633393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.633393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.633393] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d54f907b-db84-48ab-abc7-6edbf025059b already deleted. [ 1091.633393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.769024] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.769024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.769024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.769024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.769024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.769024] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 638f5992-652b-4deb-89c8-b409cb49bf0a is going to be created. [ 1091.790148] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.790314] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.790385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.790597] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.790760] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.798950] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 638f5992-652b-4deb-89c8-b409cb49bf0a in Status: UNINITIALIZED for 2s [ 1091.919022] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 in Status: SUCCESS [ 1091.919148] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 deletion is rescheduled due to dependency. [ 1091.919239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.937696] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.938362] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.938362] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.938495] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.938566] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.938726] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 66d8cd75-d28d-42be-b886-cd2538f0ec63 not found, creating... [ 1091.939048] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.939230] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.939354] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.939586] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.939730] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.940057] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.940241] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.940393] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.940613] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.940753] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.940900] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 66d8cd75-d28d-42be-b886-cd2538f0ec63 is going to be created. [ 1091.969585] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.969814] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.969964] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.970277] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.970603] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.970736] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-66d8cd75-d28d-42be-b886-cd2538f0ec63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.001832] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.001971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.002078] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.002280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.002377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.002580] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.002677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.002741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.002894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.002975] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.003075] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be updated. [ 1092.049101] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.049336] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.049336] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.049563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.049703] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.059166] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 1092.671656] env[71140]: INFO networking_nsxv3.common.synchronization [req-0d0d796f-237f-43c7-91c5-480cc173f563 req-f3e8c4ab-b03d-4fd4-a3f4-29afd889365e service nova] Enqueued Resource ID: d54f907b-db84-48ab-abc7-6edbf025059b with Priority: HIGHEST for action security_group_rules [ 1092.672332] env[71140]: INFO networking_nsxv3.common.synchronization [req-0d0d796f-237f-43c7-91c5-480cc173f563 req-f3e8c4ab-b03d-4fd4-a3f4-29afd889365e service nova] Enqueued Resource ID: d54f907b-db84-48ab-abc7-6edbf025059b with Priority: HIGHEST for action security_group_members [ 1092.672332] env[71140]: INFO networking_nsxv3.common.synchronization [req-0d0d796f-237f-43c7-91c5-480cc173f563 req-f3e8c4ab-b03d-4fd4-a3f4-29afd889365e service nova] Enqueued Resource ID: 66d8cd75-d28d-42be-b886-cd2538f0ec63 with Priority: HIGHEST for action port [ 1092.672523] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d54f907b-db84-48ab-abc7-6edbf025059b with Priority: HIGHEST for action security_group_rules [ 1092.672656] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d54f907b-db84-48ab-abc7-6edbf025059b with Priority: HIGHEST for action security_group_members [ 1092.672769] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66d8cd75-d28d-42be-b886-cd2538f0ec63 with Priority: HIGHEST for action port [ 1092.673085] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d54f907b-db84-48ab-abc7-6edbf025059b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.673220] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.673284] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.673866] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.673866] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d54f907b-db84-48ab-abc7-6edbf025059b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.674448] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d54f907b-db84-48ab-abc7-6edbf025059b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.674588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.674652] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.674817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.674970] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.675078] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.675140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.675295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.675379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.675477] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d54f907b-db84-48ab-abc7-6edbf025059b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.676233] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-66d8cd75-d28d-42be-b886-cd2538f0ec63 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.676336] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66d8cd75-d28d-42be-b886-cd2538f0ec63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.676411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66d8cd75-d28d-42be-b886-cd2538f0ec63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.676565] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66d8cd75-d28d-42be-b886-cd2538f0ec63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.676901] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66d8cd75-d28d-42be-b886-cd2538f0ec63',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.179354] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d54f907b-db84-48ab-abc7-6edbf025059b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.180538] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d54f907b-db84-48ab-abc7-6edbf025059b taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.180661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.183352] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66d8cd75-d28d-42be-b886-cd2538f0ec63 with status ACTIVE [ 1093.183352] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.183352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.183352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.183352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.183352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.183352] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.183352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.183352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.183352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.183352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.183909] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.183909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.183909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.183909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.183909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.183909] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66d8cd75-d28d-42be-b886-cd2538f0ec63 is going to be updated. [ 1093.204384] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.204524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.204596] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.204808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.204939] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.205110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66d8cd75-d28d-42be-b886-cd2538f0ec63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.687025] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d54f907b-db84-48ab-abc7-6edbf025059b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.808683] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 638f5992-652b-4deb-89c8-b409cb49bf0a in Status: SUCCESS [ 1093.808973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.809198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.809438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.809635] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.809754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.809832] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.809979] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.810073] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.810182] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.810282] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('638f5992-652b-4deb-89c8-b409cb49bf0a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.068181] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 1094.068504] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 deletion is rescheduled due to dependency. [ 1094.068646] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.190289] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.190491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.190536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.190730] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.190803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.190911] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d54f907b-db84-48ab-abc7-6edbf025059b is going to be created. [ 1094.219851] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.219986] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.220065] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.220286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.220438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.234369] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d54f907b-db84-48ab-abc7-6edbf025059b in Status: UNINITIALIZED for 2s [ 1094.312914] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('638f5992-652b-4deb-89c8-b409cb49bf0a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.815594] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 638f5992-652b-4deb-89c8-b409cb49bf0a: rpc.has_security_group_logging(os_id): False [ 1094.833167] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.833375] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.833467] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.833771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.833899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.834238] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.834789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.834789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.834789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.834789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.834966] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 638f5992-652b-4deb-89c8-b409cb49bf0a is going to be created. [ 1094.890810] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.891036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.891121] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.891380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.891541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.902275] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 638f5992-652b-4deb-89c8-b409cb49bf0a in Status: IN_PROGRESS for 2s [ 1096.243872] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d54f907b-db84-48ab-abc7-6edbf025059b in Status: SUCCESS [ 1096.244470] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.244820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.245141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.245500] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.245723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.245886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.246956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.246956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.246956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.246956] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d54f907b-db84-48ab-abc7-6edbf025059b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.749213] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d54f907b-db84-48ab-abc7-6edbf025059b taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.749422] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.749467] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.749660] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.749825] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.749936] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.750017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.750174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.750263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.750353] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.750500] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d54f907b-db84-48ab-abc7-6edbf025059b taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.750593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.750667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.750794] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.750932] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.751030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.751095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.751232] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.751306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.751386] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.751477] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d54f907b-db84-48ab-abc7-6edbf025059b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.920069] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 638f5992-652b-4deb-89c8-b409cb49bf0a in Status: SUCCESS [ 1096.920340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.254098] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d54f907b-db84-48ab-abc7-6edbf025059b: rpc.has_security_group_logging(os_id): False [ 1097.271365] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.271547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.271627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.271879] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.271981] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.272275] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.272406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.272478] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.272675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.272773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.272981] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.273098] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.273261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.273329] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.273440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.273674] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.273775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.273836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.274023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.274084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.274325] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d54f907b-db84-48ab-abc7-6edbf025059b is going to be created. [ 1097.328877] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.329159] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.329282] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.329620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.329831] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.343860] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d54f907b-db84-48ab-abc7-6edbf025059b in Status: IN_PROGRESS for 2s [ 1097.674166] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1097.674270] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1099.357101] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d54f907b-db84-48ab-abc7-6edbf025059b in Status: SUCCESS [ 1099.357393] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.674901] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1102.675234] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1103.103705] env[71140]: INFO networking_nsxv3.common.synchronization [None req-1def59c6-5804-4813-abe3-a1c0628ea489 None None] Enqueued Resource ID: e6c36f4a-676d-4ff7-8ddf-59ef820fa815 with Priority: HIGHEST for action port [ 1103.104373] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6c36f4a-676d-4ff7-8ddf-59ef820fa815 with Priority: HIGHEST for action port [ 1103.104807] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6c36f4a-676d-4ff7-8ddf-59ef820fa815 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.105015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6c36f4a-676d-4ff7-8ddf-59ef820fa815" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.105139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6c36f4a-676d-4ff7-8ddf-59ef820fa815" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.105491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6c36f4a-676d-4ff7-8ddf-59ef820fa815" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.105599] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6c36f4a-676d-4ff7-8ddf-59ef820fa815',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.608018] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6c36f4a-676d-4ff7-8ddf-59ef820fa815 [ 1103.608287] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.608420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.608505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.608718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.608806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.608944] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6c36f4a-676d-4ff7-8ddf-59ef820fa815 already deleted. [ 1103.608987] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6c36f4a-676d-4ff7-8ddf-59ef820fa815" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.672158] env[71140]: INFO networking_nsxv3.common.synchronization [req-be42fe9f-6eca-48cd-b3e9-438322aac587 req-7888ca7b-ebed-4a80-b73f-6aad34ab8867 tempest-ServersTestJSON-1092316267 tempest-ServersTestJSON-1092316267-project-member] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1103.672711] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1103.676226] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.676518] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.676518] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.676643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.676830] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.676943] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.677157] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.677245] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.677311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.677407] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.850214] env[71140]: INFO networking_nsxv3.common.synchronization [req-90c4e5df-cce8-4851-ac25-73626e2c3a85 req-d332bb55-8fc9-498b-9904-3f625078985e tempest-AttachInterfacesUnderV243Test-701512252 tempest-AttachInterfacesUnderV243Test-701512252-project-member] Enqueued Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_members [ 1103.850214] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_members [ 1103.850214] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-77acb82c-557e-4c76-a0f0-8f86422bacf5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.851042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.851293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.851600] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.851884] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.852340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.855110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.855110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.855110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.855110] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.871082] env[71140]: INFO networking_nsxv3.common.synchronization [req-90c4e5df-cce8-4851-ac25-73626e2c3a85 req-d332bb55-8fc9-498b-9904-3f625078985e tempest-AttachInterfacesUnderV243Test-701512252 tempest-AttachInterfacesUnderV243Test-701512252-project-member] Enqueued Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_rules [ 1103.871082] env[71140]: INFO networking_nsxv3.common.synchronization [req-90c4e5df-cce8-4851-ac25-73626e2c3a85 req-d332bb55-8fc9-498b-9904-3f625078985e tempest-AttachInterfacesUnderV243Test-701512252 tempest-AttachInterfacesUnderV243Test-701512252-project-member] Enqueued Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_members [ 1103.871975] env[71140]: INFO networking_nsxv3.common.synchronization [req-90c4e5df-cce8-4851-ac25-73626e2c3a85 req-d332bb55-8fc9-498b-9904-3f625078985e tempest-AttachInterfacesUnderV243Test-701512252 tempest-AttachInterfacesUnderV243Test-701512252-project-member] Enqueued Resource ID: 583e25b2-78f9-4229-876f-6e37c2a139c8 with Priority: HIGHEST for action port [ 1103.871975] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_rules [ 1103.871975] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_members [ 1103.871975] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583e25b2-78f9-4229-876f-6e37c2a139c8 with Priority: HIGHEST for action port [ 1103.872340] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77acb82c-557e-4c76-a0f0-8f86422bacf5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.872504] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.872608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.872860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.872983] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.873953] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-77acb82c-557e-4c76-a0f0-8f86422bacf5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.874818] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.875169] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-583e25b2-78f9-4229-876f-6e37c2a139c8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.875338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.875442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.875844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.875844] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('583e25b2-78f9-4229-876f-6e37c2a139c8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.180922] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.292655] env[71140]: INFO networking_nsxv3.common.synchronization [req-2c4b3fb7-e396-475d-b3ce-f75cb019ff42 req-ed807d0e-cf8a-4cb5-bb4b-7a48c2bd2630 tempest-InstanceActionsNegativeTestJSON-813148999 tempest-InstanceActionsNegativeTestJSON-813148999-project-member] Enqueued Resource ID: d54f907b-db84-48ab-abc7-6edbf025059b with Priority: HIGHEST for action security_group_members [ 1104.293279] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d54f907b-db84-48ab-abc7-6edbf025059b with Priority: HIGHEST for action security_group_members [ 1104.295032] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d54f907b-db84-48ab-abc7-6edbf025059b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.297787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.297787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.297787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.297787] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.297787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.297787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.297787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.297787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.297787] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d54f907b-db84-48ab-abc7-6edbf025059b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.355787] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.377563] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-77acb82c-557e-4c76-a0f0-8f86422bacf5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.377719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.377847] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 583e25b2-78f9-4229-876f-6e37c2a139c8 with status ACTIVE [ 1104.378028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.378505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.378505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.378505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.378505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.378677] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.378727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.379087] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.379087] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.379087] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.379288] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.379356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.379499] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.379555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.380180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.380180] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 583e25b2-78f9-4229-876f-6e37c2a139c8 is going to be updated. [ 1104.390893] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-452 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.391546] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.391735] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.392015] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.392297] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.392465] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.392587] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.392804] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.392954] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.393189] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.393312] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.393569] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.393621] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.393698] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.393799] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.393935] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.415629] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.415899] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1104.417141] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.417141] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.417141] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-3e914a24-9a93-4379-b4da-f0ca145a98b5 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.417411] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-3e914a24-9a93-4379-b4da-f0ca145a98b5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.417411] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-3e914a24-9a93-4379-b4da-f0ca145a98b5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.418088] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-3e914a24-9a93-4379-b4da-f0ca145a98b5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.418287] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e914a24-9a93-4379-b4da-f0ca145a98b5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.422697] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.422889] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.423015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.423297] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.423487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.423701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.689584] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.800060] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.802960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.802960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.802960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.802960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.802960] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.802960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.802960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.802960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.802960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.802960] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d54f907b-db84-48ab-abc7-6edbf025059b is going to be updated. [ 1104.828568] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.832017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.832017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.832017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.832017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.837885] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d54f907b-db84-48ab-abc7-6edbf025059b in Status: IN_PROGRESS for 2s [ 1104.858193] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.921109] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.921398] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.921610] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.921950] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.922183] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.922374] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 3e914a24-9a93-4379-b4da-f0ca145a98b5 not found, creating... [ 1104.922703] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.922879] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.923037] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.923712] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.923712] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.923838] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.923927] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.924223] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.924302] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.924439] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.924610] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 3e914a24-9a93-4379-b4da-f0ca145a98b5 is going to be created. [ 1104.944366] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.944754] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.944881] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.945140] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.945450] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.945742] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-3e914a24-9a93-4379-b4da-f0ca145a98b5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.191795] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.192056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.192165] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.192310] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.192406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.192524] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1105.228351] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.228506] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.228580] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.228882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.229067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.238272] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1105.363877] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.363877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.363877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.363877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.363877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.363877] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 is going to be updated. [ 1105.394272] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.394272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.394272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.394272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.394272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.409924] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 in Status: IN_PROGRESS for 2s [ 1105.448534] env[71140]: INFO networking_nsxv3.common.synchronization [None req-68088660-6578-46e7-81f4-c21386cc2454 None None] Enqueued Resource ID: 96ca1040-a5e3-4974-a85a-74cabf7d4b3d with Priority: HIGHEST for action port [ 1105.449050] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96ca1040-a5e3-4974-a85a-74cabf7d4b3d with Priority: HIGHEST for action port [ 1105.450333] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-96ca1040-a5e3-4974-a85a-74cabf7d4b3d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.450566] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96ca1040-a5e3-4974-a85a-74cabf7d4b3d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.450663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96ca1040-a5e3-4974-a85a-74cabf7d4b3d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.450972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96ca1040-a5e3-4974-a85a-74cabf7d4b3d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.451104] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96ca1040-a5e3-4974-a85a-74cabf7d4b3d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.766017] env[71140]: INFO networking_nsxv3.common.synchronization [req-be42fe9f-6eca-48cd-b3e9-438322aac587 req-ea3d3d52-f09e-4d2e-89c3-18219fa796d5 service nova] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_rules [ 1105.766274] env[71140]: INFO networking_nsxv3.common.synchronization [req-be42fe9f-6eca-48cd-b3e9-438322aac587 req-ea3d3d52-f09e-4d2e-89c3-18219fa796d5 service nova] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1105.766435] env[71140]: INFO networking_nsxv3.common.synchronization [req-be42fe9f-6eca-48cd-b3e9-438322aac587 req-ea3d3d52-f09e-4d2e-89c3-18219fa796d5 service nova] Enqueued Resource ID: 3e914a24-9a93-4379-b4da-f0ca145a98b5 with Priority: HIGHEST for action port [ 1105.767078] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_rules [ 1105.767298] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1105.767430] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e914a24-9a93-4379-b4da-f0ca145a98b5 with Priority: HIGHEST for action port [ 1105.767733] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.769360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.769360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.769360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.769360] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.769360] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.769628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.769665] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e914a24-9a93-4379-b4da-f0ca145a98b5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.769751] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e914a24-9a93-4379-b4da-f0ca145a98b5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.769814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e914a24-9a93-4379-b4da-f0ca145a98b5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.769983] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e914a24-9a93-4379-b4da-f0ca145a98b5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.770068] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e914a24-9a93-4379-b4da-f0ca145a98b5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.953472] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96ca1040-a5e3-4974-a85a-74cabf7d4b3d [ 1105.953831] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.953973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.954056] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.954630] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.954773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.955084] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96ca1040-a5e3-4974-a85a-74cabf7d4b3d already deleted. [ 1105.955218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96ca1040-a5e3-4974-a85a-74cabf7d4b3d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.271399] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.271536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.274856] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e914a24-9a93-4379-b4da-f0ca145a98b5 with status ACTIVE [ 1106.275054] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.275174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.275243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.275499] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.275570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.275761] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.275860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.275923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.276093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.276171] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.276364] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.276474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.276536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.276690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.276765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.276847] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e914a24-9a93-4379-b4da-f0ca145a98b5 is going to be updated. [ 1106.299390] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.299519] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.299599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.299777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.299903] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.300073] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e914a24-9a93-4379-b4da-f0ca145a98b5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.847647] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d54f907b-db84-48ab-abc7-6edbf025059b in Status: SUCCESS [ 1106.848021] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d54f907b-db84-48ab-abc7-6edbf025059b deletion is rescheduled due to dependency. [ 1106.848021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.928036] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.928036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.928036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.928257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.928379] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.211043] env[71140]: INFO networking_nsxv3.common.synchronization [req-af770a7a-d3f6-43cb-a248-aa09345f2fef req-7736b850-1c30-4406-b370-2f225e0dd909 tempest-AttachInterfacesUnderV243Test-701512252 tempest-AttachInterfacesUnderV243Test-701512252-project-member] Enqueued Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_members [ 1107.211043] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_members [ 1107.211195] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-77acb82c-557e-4c76-a0f0-8f86422bacf5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.211250] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.227576] env[71140]: INFO networking_nsxv3.common.synchronization [req-af770a7a-d3f6-43cb-a248-aa09345f2fef req-7736b850-1c30-4406-b370-2f225e0dd909 tempest-AttachInterfacesUnderV243Test-701512252 tempest-AttachInterfacesUnderV243Test-701512252-project-member] Enqueued Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_rules [ 1107.227576] env[71140]: INFO networking_nsxv3.common.synchronization [req-af770a7a-d3f6-43cb-a248-aa09345f2fef req-7736b850-1c30-4406-b370-2f225e0dd909 tempest-AttachInterfacesUnderV243Test-701512252 tempest-AttachInterfacesUnderV243Test-701512252-project-member] Enqueued Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_members [ 1107.227723] env[71140]: INFO networking_nsxv3.common.synchronization [req-af770a7a-d3f6-43cb-a248-aa09345f2fef req-7736b850-1c30-4406-b370-2f225e0dd909 tempest-AttachInterfacesUnderV243Test-701512252 tempest-AttachInterfacesUnderV243Test-701512252-project-member] Enqueued Resource ID: 583e25b2-78f9-4229-876f-6e37c2a139c8 with Priority: HIGHEST for action port [ 1107.228409] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_rules [ 1107.228591] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_members [ 1107.229118] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583e25b2-78f9-4229-876f-6e37c2a139c8 with Priority: HIGHEST for action port [ 1107.229118] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77acb82c-557e-4c76-a0f0-8f86422bacf5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.229261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.229477] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-77acb82c-557e-4c76-a0f0-8f86422bacf5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.229572] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.229798] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-583e25b2-78f9-4229-876f-6e37c2a139c8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.229942] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.230019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.232902] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.232902] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('583e25b2-78f9-4229-876f-6e37c2a139c8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.248542] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1107.248796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.249158] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.249647] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.249647] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.249647] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.249804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.250354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.250354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.250354] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.418835] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 in Status: SUCCESS [ 1107.418835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.419102] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.419385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.419691] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.419848] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.419920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.420112] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.420238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.420357] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.430998] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.735865] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 583e25b2-78f9-4229-876f-6e37c2a139c8 with status ACTIVE [ 1107.736372] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.736574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.736692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.736872] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.737032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.737232] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.737340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.737407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.737569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.737650] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.738106] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.738106] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.738106] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.738222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.738254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.738331] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 583e25b2-78f9-4229-876f-6e37c2a139c8 is going to be updated. [ 1107.753569] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.759388] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.759537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.759604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.759886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.760076] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.760275] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.923457] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.935504] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.974784] env[71140]: INFO networking_nsxv3.common.synchronization [req-a9d329fe-e86d-4262-bae1-25fd38607979 req-85333a3b-1f00-43a2-a115-55dca9534411 tempest-ListImageFiltersTestJSON-1329577525 tempest-ListImageFiltersTestJSON-1329577525-project-member] Enqueued Resource ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 with Priority: HIGHEST for action security_group_members [ 1107.974784] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 with Priority: HIGHEST for action security_group_members [ 1107.974784] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2548cfa1-8571-4be8-becb-2b5d950d7202 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.974784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.974784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.974784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.974784] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.974784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.974784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.974784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.974784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.974784] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2548cfa1-8571-4be8-becb-2b5d950d7202',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.187278] env[71140]: INFO networking_nsxv3.common.synchronization [None req-f1af296d-1a88-4e87-9e77-09ad0519c90a tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_rules [ 1108.187278] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_rules [ 1108.187278] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83375852-3b13-42bc-b95c-09c5949dc69a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.187278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.187278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.188397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.188494] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.259998] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.259998] env[71140]: INFO networking_nsxv3.common.synchronization [None req-a1d0183f-90da-47ee-8966-9a955436daf6 tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_rules [ 1108.259998] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_rules [ 1108.259998] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83375852-3b13-42bc-b95c-09c5949dc69a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.259998] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.430679] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.443101] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1108.443101] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1108.479881] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.479881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.479881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.479881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.479881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.479881] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.479881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.479881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.479881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.479881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.479881] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 is going to be updated. [ 1108.504578] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.504578] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.504779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.504855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.504968] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.513089] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 in Status: IN_PROGRESS for 2s [ 1108.711094] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.711327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.711327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.711913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.711913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.711913] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83375852-3b13-42bc-b95c-09c5949dc69a already deleted. [ 1108.711913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.712101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.712101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.712179] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.762016] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.762187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.762260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.762489] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.762622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.762672] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1108.790113] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.790302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.790367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.790594] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.790737] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.798478] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1108.934931] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.934931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.934931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.934931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.934931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.934931] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 is going to be updated. [ 1108.960525] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.960709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.960785] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.961155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.961155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.970253] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 in Status: IN_PROGRESS for 2s [ 1109.251866] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.251866] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.251866] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.251866] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.252095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.252095] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83375852-3b13-42bc-b95c-09c5949dc69a already deleted. [ 1109.252095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.328273] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.328460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.328537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.328805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.351028] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1109.351028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.351574] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1109.383041] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.383041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.383041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.383789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.397468] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.398323] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:1. [ 1109.398323] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'583e25b2-78f9-4229-876f-6e37c2a139c8'} {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1109.398468] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1109.446015] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.446015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.446211] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.446281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.448214] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.448444] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1109.521022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.521022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.521022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.521022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.521022] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.521022] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1109.605180] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.605180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.605180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.605180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.605180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.605180] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:51. [ 1109.605180] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'77acb82c-557e-4c76-a0f0-8f86422bacf5', '0021f162-837d-4356-afbf-4e10e33828d6', 'a18e682e-ac56-4e1b-bb5d-a95392ee84c6', 'f3b2c834-9214-45cf-a32f-db5f411105f6', '184bb91c-9526-466a-820b-ced20908d98e', '8c99ec8b-0259-4916-a240-54938fc5a81c', 'e2975c43-5d19-4643-8076-5d24f0ea84c6', '30ff0c23-f932-4ef1-8e47-6bf1171fa339', '1100ce56-f855-47e4-96bb-f4bbe37e7632', '94b91392-e2c9-4bb1-8e2f-6bc3569d8721', '638f5992-652b-4deb-89c8-b409cb49bf0a', '4c549bd3-468a-4655-b709-3480ff374e11', 'd3f5bae4-a3a0-45b0-a27b-8d93ffb5c470', 'd54f907b-db84-48ab-abc7-6edbf025059b', 'fcc20535-4cb4-4221-b041-8dd02e4b3787', '00f8a236-f7eb-4e78-a4ac-ee225ba9532d', '8623c530-dbd9-4cff-983a-f2df2ac9ad58', '6f6ea965-586b-4847-a20f-3619378cb260', 'a9372f7d-fcc5-4703-b77d-bbb4d1695328', '43a772d0-e00d-4627-ad2d-c6c3ccbcee06', '30d81b57-1e7d-4b6c-8223-18f586dd832a', '89ab7a19-079c-4b53-bee2-637fae5e2fc1', 'e42db4b7-b71b-4297-acb7-b4910e7af664', 'e1516d35-770d-4ac2-bf00-b0eed6f837f7', '4143c3a0-53e5-4025-8a89-c9d1e7dbb668', 'a008c941-3472-43c0-815f-ad4259496329', 'dc7015c2-a058-452d-bfd5-0575d4a237f8', '893ec538-5364-452f-9431-cbce81e1231d', '622a5b07-14ae-44ec-94dd-57b4349034a7', '522bdeb8-3be1-4507-b2cc-adc33ff88371', '66227fe8-4a5f-47ba-add3-defc26d5bd6a', '1b5a6141-3574-468b-87ed-785459f7a84a', '6e8717ad-052a-4a86-b223-df55dd81c619', '3e62d50e-c934-4166-825a-6649880de6a7', '878a96b3-04c2-49e0-a7d2-cbbb47bf5319', 'f9ec394c-128b-4456-9eb1-76442418ea09', 'bc92ef18-2831-4b38-acbe-82e66080661f', 'c62a92b8-4863-4e9d-809d-e8687b429f2a', 'e12e6f08-d99f-4fd3-9323-d04895bd2256', '6cb57d72-3644-432b-8c2c-9a03c173956e', 'dea05fd0-2f31-49b2-a904-3b840403e3a7', '9a300b78-a05e-47a1-bd01-b7e39a483342', '083af43f-5ab0-4b05-a7bb-d6121e5f0390', '604d5290-2f79-4d99-b6f1-1e0335d615a9', '54bba0b8-b95d-4902-8afe-f2600efb516b', 'f3e5dc50-8f82-494d-8a76-86f2e68a6f6a', 'a6eb3617-ce46-425c-b053-a5240fa9c14e', 'b2ad47d5-b746-415d-9e5e-05d9539a1fb9', 'd7d76214-330f-43f9-a3bd-c36a084b6ab5', '2548cfa1-8571-4be8-becb-2b5d950d7202', '40b2250b-502e-4365-a6ba-2ea8c2fa6c5e'} {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1109.605180] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1109.639607] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.639607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.639607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.639607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.639607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.639607] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1109.639607] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1109.639607] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1109.721601] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.721757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.721796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.722026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.723241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.723515] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1109.723614] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1109.723677] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1109.723759] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Ports [ 1109.723801] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 583e25b2-78f9-4229-876f-6e37c2a139c8 with Priority: HIGH for action port [ 1109.724030] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 19/51 resources of Type:Security Group Rules [ 1109.724030] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGH for action security_group_rules [ 1109.724030] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGH for action security_group_rules [ 1109.724223] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGH for action security_group_rules [ 1109.724223] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3b2c834-9214-45cf-a32f-db5f411105f6 with Priority: HIGH for action security_group_rules [ 1109.724223] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGH for action security_group_rules [ 1109.724335] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGH for action security_group_rules [ 1109.724335] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGH for action security_group_rules [ 1109.724395] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGH for action security_group_rules [ 1109.724425] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGH for action security_group_rules [ 1109.724499] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGH for action security_group_rules [ 1109.724544] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 638f5992-652b-4deb-89c8-b409cb49bf0a with Priority: HIGH for action security_group_rules [ 1109.724932] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGH for action security_group_rules [ 1109.724932] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGH for action security_group_rules [ 1109.724932] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d54f907b-db84-48ab-abc7-6edbf025059b with Priority: HIGH for action security_group_rules [ 1109.724932] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 with Priority: HIGH for action security_group_rules [ 1109.724932] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d with Priority: HIGH for action security_group_rules [ 1109.724932] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 with Priority: HIGH for action security_group_rules [ 1109.724932] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6f6ea965-586b-4847-a20f-3619378cb260 with Priority: HIGH for action security_group_rules [ 1109.725268] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 with Priority: HIGH for action security_group_rules [ 1109.725268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.887747] env[71140]: INFO networking_nsxv3.common.synchronization [req-56b7c287-3350-43fe-8fa9-583272c68bab req-e245c90d-0757-41fe-8cef-70976528772f tempest-ServerActionsTestOtherB-2025667431 tempest-ServerActionsTestOtherB-2025667431-project-member] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 1109.887747] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 1109.887747] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583e25b2-78f9-4229-876f-6e37c2a139c8 with Priority: HIGH for action port [ 1109.887988] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0021f162-837d-4356-afbf-4e10e33828d6 with Priority: HIGH for action security_group_rules [ 1109.887988] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGH for action security_group_rules [ 1109.888059] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d54f907b-db84-48ab-abc7-6edbf025059b with Priority: HIGH for action security_group_rules [ 1109.888143] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 with Priority: HIGH for action security_group_rules [ 1109.888233] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6ea965-586b-4847-a20f-3619378cb260 with Priority: HIGH for action security_group_rules [ 1109.888327] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 with Priority: HIGH for action security_group_rules [ 1109.888419] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d with Priority: HIGH for action security_group_rules [ 1109.888508] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 with Priority: HIGH for action security_group_rules [ 1109.888690] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 with Priority: HIGH for action security_group_rules [ 1109.888820] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGH for action security_group_rules [ 1109.888936] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638f5992-652b-4deb-89c8-b409cb49bf0a with Priority: HIGH for action security_group_rules [ 1109.889042] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 with Priority: HIGH for action security_group_rules [ 1109.889161] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 with Priority: HIGH for action security_group_rules [ 1109.889304] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 with Priority: HIGH for action security_group_rules [ 1109.889401] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bb91c-9526-466a-820b-ced20908d98e with Priority: HIGH for action security_group_rules [ 1109.889487] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 with Priority: HIGH for action security_group_rules [ 1109.889604] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b2c834-9214-45cf-a32f-db5f411105f6 with Priority: HIGH for action security_group_rules [ 1109.889715] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGH for action security_group_rules [ 1109.889825] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 with Priority: HIGH for action security_group_rules [ 1109.890157] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.890337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.890443] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.890669] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.890851] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.890978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.891085] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.891264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.891376] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.891491] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.892368] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-583e25b2-78f9-4229-876f-6e37c2a139c8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.892976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.892976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.892976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.892976] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('583e25b2-78f9-4229-876f-6e37c2a139c8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.894065] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0021f162-837d-4356-afbf-4e10e33828d6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.894164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.894244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.894416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.897020] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0021f162-837d-4356-afbf-4e10e33828d6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.897020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.897020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.897020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.897020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.897020] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.897020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d54f907b-db84-48ab-abc7-6edbf025059b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.897020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.897020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.897020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.897020] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d54f907b-db84-48ab-abc7-6edbf025059b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.897611] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.897611] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.897611] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.897835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.897835] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9372f7d-fcc5-4703-b77d-bbb4d1695328',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.898726] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f6ea965-586b-4847-a20f-3619378cb260 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.898783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.898812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.898950] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.899273] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f6ea965-586b-4847-a20f-3619378cb260',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.899984] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.900133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.900223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.900411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.900505] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8623c530-dbd9-4cff-983a-f2df2ac9ad58',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.901199] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.901348] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.901431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.901614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.901685] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f8a236-f7eb-4e78-a4ac-ee225ba9532d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.902397] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.902532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.902615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.902783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.902875] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.903705] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcc20535-4cb4-4221-b041-8dd02e4b3787 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.903804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.903928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.904112] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.904206] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcc20535-4cb4-4221-b041-8dd02e4b3787',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.904892] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.904995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.905072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.905223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.905297] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.905962] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-638f5992-652b-4deb-89c8-b409cb49bf0a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.906144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.906235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.906411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.906508] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('638f5992-652b-4deb-89c8-b409cb49bf0a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.907339] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.907490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.907578] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.907753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.907850] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94b91392-e2c9-4bb1-8e2f-6bc3569d8721',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.908548] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1100ce56-f855-47e4-96bb-f4bbe37e7632 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.908706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.908795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.909165] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.909165] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1100ce56-f855-47e4-96bb-f4bbe37e7632',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.909746] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.909856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.909921] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.910087] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.910160] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30ff0c23-f932-4ef1-8e47-6bf1171fa339',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.910814] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-184bb91c-9526-466a-820b-ced20908d98e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.910929] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.910996] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.911159] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.911231] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('184bb91c-9526-466a-820b-ced20908d98e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.912395] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2975c43-5d19-4643-8076-5d24f0ea84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.912536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.912625] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.912798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.912905] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2975c43-5d19-4643-8076-5d24f0ea84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.914021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3b2c834-9214-45cf-a32f-db5f411105f6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.914164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.914254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.914443] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.914536] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3b2c834-9214-45cf-a32f-db5f411105f6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.915473] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77acb82c-557e-4c76-a0f0-8f86422bacf5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.916069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.916069] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a18e682e-ac56-4e1b-bb5d-a95392ee84c6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.916069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.916069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.916371] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.916479] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a18e682e-ac56-4e1b-bb5d-a95392ee84c6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.418703] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-638f5992-652b-4deb-89c8-b409cb49bf0a taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.419069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.419069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.419176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.419392] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.419498] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.419565] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.419717] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.419808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.419894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.420695] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('638f5992-652b-4deb-89c8-b409cb49bf0a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.424332] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8623c530-dbd9-4cff-983a-f2df2ac9ad58 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.424460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.424543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.424663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.424824] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.424909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.424966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.425129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.425210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.425288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.425371] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8623c530-dbd9-4cff-983a-f2df2ac9ad58',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.426156] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.426308] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.426383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.426541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.427335] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 583e25b2-78f9-4229-876f-6e37c2a139c8 with status ACTIVE [ 1110.427495] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.427598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.427806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.427806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.427887] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.428048] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.428155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.428223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.428378] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.428406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.428588] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.428686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.428749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.428870] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.428935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.429047] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 583e25b2-78f9-4229-876f-6e37c2a139c8 is going to be updated. [ 1110.431233] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9372f7d-fcc5-4703-b77d-bbb4d1695328 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.431401] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.431401] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.431563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.431715] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.431905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.431905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.432012] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.432077] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.432130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.432209] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9372f7d-fcc5-4703-b77d-bbb4d1695328',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.495308] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.495431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.496360] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.496469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.497230] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.497361] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.502699] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.502817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.503513] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.503614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.504310] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.504420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.505164] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.505262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.505995] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.506102] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.506782] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.506880] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.507868] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.507962] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.508558] env[71140]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1110.508951] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.509054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.509653] env[71140]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1110.510032] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.510131] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.510853] env[71140]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1110.511271] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.511414] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.511526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.511768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.511916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.512084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-583e25b2-78f9-4229-876f-6e37c2a139c8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.512673] env[71140]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1110.513089] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.513221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.514866] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.514963] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.515581] env[71140]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1110.515959] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.516098] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.520310] env[71140]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1110.520704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.520888] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.520997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.521080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.521349] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.521349] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.521433] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c is going to be updated. [ 1110.522232] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.522396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.522480] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.522574] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c is going to be deleted. [ 1110.524209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.524420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.528744] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 in Status: SUCCESS [ 1110.528922] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2548cfa1-8571-4be8-becb-2b5d950d7202 deletion is rescheduled due to dependency. [ 1110.529039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2548cfa1-8571-4be8-becb-2b5d950d7202" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.551799] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.551939] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.552019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.552244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.552480] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.559758] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: IN_PROGRESS for 2s [ 1110.561786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.561885] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1100ce56-f855-47e4-96bb-f4bbe37e7632 is going to be deleted. [ 1110.562708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.562893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.584863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.585044] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30ff0c23-f932-4ef1-8e47-6bf1171fa339 is going to be deleted. [ 1110.585974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.586218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.600615] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.600776] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.618929] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.619206] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470 is going to be deleted. [ 1110.620135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.620401] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.622021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.622137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.674564] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.674700] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.682947] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.683129] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0021f162-837d-4356-afbf-4e10e33828d6 is going to be deleted. [ 1110.684092] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.684328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.736048] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.736184] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d54f907b-db84-48ab-abc7-6edbf025059b is going to be deleted. [ 1110.737108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.737388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.799280] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.799280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.812171] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.812171] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f6ea965-586b-4847-a20f-3619378cb260 is going to be deleted. [ 1110.812541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.812757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.824288] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1110.824531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.824705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.824910] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.825108] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.825225] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.825289] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.825444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.825524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.825601] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.825690] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.842137] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.842269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.862353] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.862534] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be deleted. [ 1110.863498] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.863713] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.897095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.897370] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2975c43-5d19-4643-8076-5d24f0ea84c6 is going to be deleted. [ 1110.898263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.898469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.926371] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('638f5992-652b-4deb-89c8-b409cb49bf0a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.947746] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.947937] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcc20535-4cb4-4221-b041-8dd02e4b3787 is going to be deleted. [ 1110.949407] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8623c530-dbd9-4cff-983a-f2df2ac9ad58',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.953190] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.953190] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.953527] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9372f7d-fcc5-4703-b77d-bbb4d1695328',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.955107] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.955247] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.987810] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 in Status: SUCCESS [ 1110.988016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.988188] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.988407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.988596] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.988712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.988778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.988924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.989010] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.989103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.989199] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.990011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.990176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.990338] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.990439] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.990504] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.990641] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.990718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.990804] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.998797] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.998910] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.009611] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.009733] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.026413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.026574] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f8a236-f7eb-4e78-a4ac-ee225ba9532d is going to be deleted. [ 1111.027500] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.027709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.039844] env[71140]: INFO networking_nsxv3.common.synchronization [req-89c2e530-7fd8-473a-99f3-4f4863526bc6 req-7f62852d-b1f5-49bb-8399-fe01f4bf20c7 tempest-AttachInterfacesUnderV243Test-701512252 tempest-AttachInterfacesUnderV243Test-701512252-project-member] Enqueued Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_members [ 1111.040422] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 with Priority: HIGHEST for action security_group_members [ 1111.040728] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-77acb82c-557e-4c76-a0f0-8f86422bacf5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.040830] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.048405] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.048509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.107269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.107421] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3b2c834-9214-45cf-a32f-db5f411105f6 is going to be deleted. [ 1111.108691] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.108894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.185416] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.185416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.212932] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.214237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.215289] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.215399] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a18e682e-ac56-4e1b-bb5d-a95392ee84c6 is going to be deleted. [ 1111.216352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.216584] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.263020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.263020] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 184bb91c-9526-466a-820b-ced20908d98e is going to be deleted. [ 1111.263020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.263020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.329311] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.329311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.329311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.329311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.329311] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.329311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.329311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.329311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.329697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.329697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.329697] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.329786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.329812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.329949] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.330100] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.330194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.330482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.330482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.330575] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.330638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.330730] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.360960] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.361108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.364351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.364472] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94b91392-e2c9-4bb1-8e2f-6bc3569d8721 is going to be deleted. [ 1111.365329] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.365629] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.365629] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.365713] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.365856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.366009] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.366099] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.366211] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1100ce56-f855-47e4-96bb-f4bbe37e7632" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.366661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.366925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.366925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.367101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30ff0c23-f932-4ef1-8e47-6bf1171fa339" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.367265] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.367445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.367556] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.367789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3f5bae4-a3a0-45b0-a27b-8d93ffb5c470" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.367848] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.368028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.368139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.368275] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0021f162-837d-4356-afbf-4e10e33828d6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.368429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.368599] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.368705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.368837] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d54f907b-db84-48ab-abc7-6edbf025059b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.368988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.369169] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.369289] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.369446] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f6ea965-586b-4847-a20f-3619378cb260" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.370194] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.370359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.370461] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.370642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.370754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.370898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a18e682e-ac56-4e1b-bb5d-a95392ee84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.371059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.371235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.371344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.371478] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2975c43-5d19-4643-8076-5d24f0ea84c6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.372549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.372549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.372549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.372549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.372549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.372549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.372549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.372549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f8a236-f7eb-4e78-a4ac-ee225ba9532d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.372549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.372824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.372896] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.373037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcc20535-4cb4-4221-b041-8dd02e4b3787" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.373192] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.373366] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.373472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.373605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3b2c834-9214-45cf-a32f-db5f411105f6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.423142] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.423142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.423462] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.423462] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.423515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.423632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-184bb91c-9526-466a-820b-ced20908d98e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.428058] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 638f5992-652b-4deb-89c8-b409cb49bf0a: rpc.has_security_group_logging(os_id): False [ 1111.452394] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.452581] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.452658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.452870] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.456359] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8623c530-dbd9-4cff-983a-f2df2ac9ad58: rpc.has_security_group_logging(os_id): False [ 1111.457194] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9372f7d-fcc5-4703-b77d-bbb4d1695328: rpc.has_security_group_logging(os_id): False [ 1111.476840] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.476957] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.481426] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.481543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.491896] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.493237] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.496019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.496329] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.496396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.496475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.496685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.496772] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.496878] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 638f5992-652b-4deb-89c8-b409cb49bf0a is going to be updated. [ 1111.498036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.498102] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.537036] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.537154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.542526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.542866] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.542994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.543101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.543311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.543399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.543496] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 is going to be updated. [ 1111.544574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.544750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.578032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.578523] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.578523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.578523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.578786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.578881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.578986] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 is going to be updated. [ 1111.583639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.584223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.584223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.584467] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94b91392-e2c9-4bb1-8e2f-6bc3569d8721" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.636088] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.636987] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.636987] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.636987] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.636987] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.639811] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.639811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.639811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.640013] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.640149] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.661751] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 in Status: IN_PROGRESS for 2s [ 1111.674596] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 638f5992-652b-4deb-89c8-b409cb49bf0a in Status: IN_PROGRESS for 2s [ 1111.709956] env[71140]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1111.710607] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.710781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.710820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.711036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.711211] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.743953] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 in Status: IN_PROGRESS for 2s [ 1111.835764] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e8717ad-052a-4a86-b223-df55dd81c619: rpc.has_security_group_logging(os_id): False [ 1111.854729] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.854729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.854729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.854729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.875490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.876043] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.876335] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.876550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.876872] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.878020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.878020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.878020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.878020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.878020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.878020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.878020] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.878771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.879219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.879531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.879729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.879903] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1111.947665] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.947825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.947892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.948130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.948272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.954502] env[71140]: INFO networking_nsxv3.common.synchronization [req-8526f0f5-9a8b-4e67-a589-1a7cbb301f91 req-00f0b440-7871-430a-8e61-808f44427ef3 tempest-ServerActionsTestOtherA-289074452 tempest-ServerActionsTestOtherA-289074452-project-member] Enqueued Resource ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 with Priority: HIGHEST for action security_group_members [ 1111.954749] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 with Priority: HIGHEST for action security_group_members [ 1111.955334] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-84ef6ff9-0b29-4536-8581-a65788a9e9d0 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.955454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.955534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.955767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.955916] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.956054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.956143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.956298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.956390] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.956728] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84ef6ff9-0b29-4536-8581-a65788a9e9d0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.975338] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1111.994494] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77acb82c-557e-4c76-a0f0-8f86422bacf5: rpc.has_security_group_logging(os_id): False [ 1111.995599] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.055114] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.055292] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.055365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.055620] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.082426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.082755] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.082877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.082944] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.083174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.083270] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.083345] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 is going to be updated. [ 1112.167349] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.167564] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.167641] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.167859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.168015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.182621] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 in Status: IN_PROGRESS for 2s [ 1112.229219] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-53 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.229596] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.229750] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.230053] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.230444] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.230685] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.230809] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.231068] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.231228] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.231450] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1112.231574] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1112.231688] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1112.231802] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1112.232093] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1112.232093] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1112.232195] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1112.253285] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1112.253446] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1112.254036] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1112.254036] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.254182] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-67d9c19e-e022-428a-92d9-d45f035b3f1e taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.254263] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-67d9c19e-e022-428a-92d9-d45f035b3f1e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.254356] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-67d9c19e-e022-428a-92d9-d45f035b3f1e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.254731] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-67d9c19e-e022-428a-92d9-d45f035b3f1e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.254884] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67d9c19e-e022-428a-92d9-d45f035b3f1e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.458234] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.458602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.458602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.458804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.458804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.459169] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.459169] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.459169] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.459402] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.459402] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.459482] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 already deleted. [ 1112.459532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.499076] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.499229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.499346] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.499635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.499730] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.499829] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 is going to be updated. [ 1112.526415] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.526572] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.526655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.526845] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.526984] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.535073] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 in Status: IN_PROGRESS for 2s [ 1112.569732] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: SUCCESS [ 1112.569732] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c deletion is rescheduled due to dependency. [ 1112.569732] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.757818] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.758096] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.758307] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.758606] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.758763] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.758966] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 67d9c19e-e022-428a-92d9-d45f035b3f1e not found, creating... [ 1112.759405] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.759594] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.760019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.760019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.760119] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.760448] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.760622] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.760756] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.760959] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.761116] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.761267] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 67d9c19e-e022-428a-92d9-d45f035b3f1e is going to be created. [ 1112.781268] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.781532] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.781666] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.781951] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.782202] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.782435] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-67d9c19e-e022-428a-92d9-d45f035b3f1e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.480986] env[71140]: INFO networking_nsxv3.common.synchronization [req-8526f0f5-9a8b-4e67-a589-1a7cbb301f91 req-636b80d9-8fe7-46eb-999f-7d3103ee7b37 service nova] Enqueued Resource ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 with Priority: HIGHEST for action security_group_rules [ 1113.481272] env[71140]: INFO networking_nsxv3.common.synchronization [req-8526f0f5-9a8b-4e67-a589-1a7cbb301f91 req-636b80d9-8fe7-46eb-999f-7d3103ee7b37 service nova] Enqueued Resource ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 with Priority: HIGHEST for action security_group_members [ 1113.481398] env[71140]: INFO networking_nsxv3.common.synchronization [req-8526f0f5-9a8b-4e67-a589-1a7cbb301f91 req-636b80d9-8fe7-46eb-999f-7d3103ee7b37 service nova] Enqueued Resource ID: 67d9c19e-e022-428a-92d9-d45f035b3f1e with Priority: HIGHEST for action port [ 1113.481940] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 with Priority: HIGHEST for action security_group_rules [ 1113.483702] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 with Priority: HIGHEST for action security_group_members [ 1113.483745] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67d9c19e-e022-428a-92d9-d45f035b3f1e with Priority: HIGHEST for action port [ 1113.484037] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.484458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.484565] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.484751] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.484838] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84ef6ff9-0b29-4536-8581-a65788a9e9d0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.486641] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-84ef6ff9-0b29-4536-8581-a65788a9e9d0 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.486805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.486898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.487103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.487296] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.487469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.487571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.487767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.488577] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.488577] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84ef6ff9-0b29-4536-8581-a65788a9e9d0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.489480] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-67d9c19e-e022-428a-92d9-d45f035b3f1e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.489589] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67d9c19e-e022-428a-92d9-d45f035b3f1e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.489675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67d9c19e-e022-428a-92d9-d45f035b3f1e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.490144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67d9c19e-e022-428a-92d9-d45f035b3f1e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.491295] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67d9c19e-e022-428a-92d9-d45f035b3f1e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.675447] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 in Status: SUCCESS [ 1113.675760] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.688192] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 638f5992-652b-4deb-89c8-b409cb49bf0a in Status: SUCCESS [ 1113.688405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.755070] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 in Status: SUCCESS [ 1113.755303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.918304] env[71140]: INFO networking_nsxv3.common.synchronization [None req-b071d5b4-1730-4bf7-9ff1-d3b19b18c079 tempest-AttachVolumeShelveTestJSON-926657130 tempest-AttachVolumeShelveTestJSON-926657130-project-member] Enqueued Resource ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 with Priority: HIGHEST for action security_group_rules [ 1113.918403] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 with Priority: HIGHEST for action security_group_rules [ 1113.920507] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.920507] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.920507] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.920507] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.920507] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f4aefa9-35c0-4c8a-bade-f3a9b8c62528',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.988303] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1113.988303] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.997238] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84ef6ff9-0b29-4536-8581-a65788a9e9d0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.997238] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-84ef6ff9-0b29-4536-8581-a65788a9e9d0 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.997238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.997238] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67d9c19e-e022-428a-92d9-d45f035b3f1e with status ACTIVE [ 1113.997238] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.997238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.997238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.997238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.997238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.997238] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.997238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.997238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.997238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.997238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.997952] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.997952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.997952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.997952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.999774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.000030] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67d9c19e-e022-428a-92d9-d45f035b3f1e is going to be updated. [ 1114.023252] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.023252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.023252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.023252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.023252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.023252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67d9c19e-e022-428a-92d9-d45f035b3f1e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.038293] env[71140]: INFO networking_nsxv3.common.synchronization [None req-0b1ba967-ca6f-4df1-82d1-a50272206841 tempest-AttachVolumeShelveTestJSON-926657130 tempest-AttachVolumeShelveTestJSON-926657130-project-member] Enqueued Resource ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 with Priority: HIGHEST for action security_group_rules [ 1114.038293] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 with Priority: HIGHEST for action security_group_rules [ 1114.038293] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.038293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.083978] env[71140]: INFO networking_nsxv3.common.synchronization [req-0bab74f3-64fb-400c-880e-52b2c8d38a00 req-be4d3723-ad02-4bd9-8e2b-87314313cdd2 tempest-AttachVolumeNegativeTest-950002537 tempest-AttachVolumeNegativeTest-950002537-project-member] Enqueued Resource ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 with Priority: HIGHEST for action security_group_members [ 1114.083978] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 with Priority: HIGHEST for action security_group_members [ 1114.083978] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8623c530-dbd9-4cff-983a-f2df2ac9ad58 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.083978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.083978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.085107] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.085381] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.085606] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.085751] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.086035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.086217] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.086390] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8623c530-dbd9-4cff-983a-f2df2ac9ad58',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.197771] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 in Status: SUCCESS [ 1114.197771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.197771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.197771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.197771] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.443311] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.443473] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.443538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.444067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.444212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.444317] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 already deleted. [ 1114.447383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.447383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.447383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.447383] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f4aefa9-35c0-4c8a-bade-f3a9b8c62528',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.504402] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84ef6ff9-0b29-4536-8581-a65788a9e9d0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.545790] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 in Status: SUCCESS [ 1114.546235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.546500] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.546848] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.547144] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.547637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.547799] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.548871] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.548871] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.548871] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.590200] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.590279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.591208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.591208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.591208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.591208] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.591208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.591461] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.591461] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.591523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.591597] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 is going to be updated. [ 1114.615900] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.616240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.616240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.616379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.616562] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.624039] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 in Status: IN_PROGRESS for 2s [ 1114.721342] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.721342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.721342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.721342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.721342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.721342] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 is going to be deleted. [ 1114.772218] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.772813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.772813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.774512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.774512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.774512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.774512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.774512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.774512] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.970046] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.970046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.970046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.970046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.970046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.970046] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 already deleted. [ 1114.970046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.007663] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.007901] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.007901] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.008113] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.008207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.008307] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 is going to be created. [ 1115.029404] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.029659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.029659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.029866] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.030030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.039256] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 in Status: UNINITIALIZED for 2s [ 1115.050899] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.051109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.051212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.051481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.051598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.051812] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.051913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.051979] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.052201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.052284] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.052414] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 is going to be deleted. [ 1115.079370] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.079637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.080804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.080804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.080804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.080804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.080804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.080993] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.081271] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.081428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.081659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.081825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.081955] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.082140] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77acb82c-557e-4c76-a0f0-8f86422bacf5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.295910] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.296077] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.296180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.296365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.296453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.296552] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 already deleted. [ 1115.296633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.533826] env[71140]: INFO networking_nsxv3.common.synchronization [req-974842fe-b3a5-4936-8815-a1c8de2096d6 req-83a7b16e-4f59-43ee-94cb-79f8475923a6 tempest-ServersTestJSON-1092316267 tempest-ServersTestJSON-1092316267-project-member] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1115.534428] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1115.534428] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.534428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.534682] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.534682] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.535107] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.535107] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.535107] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.541028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.541028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.541028] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.585222] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.585455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.585525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.585860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.585956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.586232] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.586337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.586432] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.586713] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.586795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.586879] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77acb82c-557e-4c76-a0f0-8f86422bacf5 already deleted. [ 1115.587042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77acb82c-557e-4c76-a0f0-8f86422bacf5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.039569] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.542846] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.633813] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 in Status: SUCCESS [ 1116.634484] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 deletion is rescheduled due to dependency. [ 1116.634484] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.046016] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.046220] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.046309] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.046525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.046618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.046717] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1117.049206] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 in Status: SUCCESS [ 1117.049438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.049587] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.049762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.049926] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.050044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.050108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.050247] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.050322] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.050421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.050514] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84ef6ff9-0b29-4536-8581-a65788a9e9d0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.071144] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.071300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.071408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.071594] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.071715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.079926] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1117.553473] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84ef6ff9-0b29-4536-8581-a65788a9e9d0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.056041] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84ef6ff9-0b29-4536-8581-a65788a9e9d0: rpc.has_security_group_logging(os_id): False [ 1118.075622] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.075795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.075840] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.076042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.076138] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.076392] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.076506] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.076574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.076733] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.076810] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.076896] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 is going to be created. [ 1118.132203] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.132369] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.132369] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.132538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.132711] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.144656] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 in Status: IN_PROGRESS for 2s [ 1119.090376] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 4s [ 1120.160389] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 in Status: SUCCESS [ 1120.160693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.535146] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1120.535262] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1121.099956] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1121.099956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.344765] env[71140]: INFO networking_nsxv3.common.synchronization [req-551c6f7a-8280-4156-bc65-62caa445d2ee req-1623812d-cf61-45be-8236-c51e824b50cb tempest-ServersNegativeTestJSON-651441888 tempest-ServersNegativeTestJSON-651441888-project-member] Enqueued Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_members [ 1122.345325] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_members [ 1122.345645] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.345758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.345823] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.346825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.346995] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.347129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.347191] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.347359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.347472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.347545] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.849630] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.849806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.849879] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.850152] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.850246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.850446] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.850549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.850612] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.850761] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.850835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.850921] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 already deleted. [ 1122.851000] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.918268] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-210 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.918472] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-210" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.918600] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-210" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.918938] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-210" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.919227] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.919389] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.919526] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.919754] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.919901] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.920161] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1122.920282] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.920395] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.920508] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.920621] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1122.920729] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.920865] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.939054] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.939236] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1122.939380] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.939628] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-210" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.939986] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.940228] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.940371] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.940716] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.940857] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da4e1e9b-6b1f-40f4-9bc7-807828d08c47',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.443647] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.444104] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.444257] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.444527] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.444681] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.445029] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port da4e1e9b-6b1f-40f4-9bc7-807828d08c47 not found, creating... [ 1123.445367] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.445545] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.445709] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.445950] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.446319] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.446634] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.446805] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.446926] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.447153] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.447289] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.447440] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: da4e1e9b-6b1f-40f4-9bc7-807828d08c47 is going to be created. [ 1123.466392] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.466610] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.466741] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.466994] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.467230] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.467541] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.612834] env[71140]: INFO networking_nsxv3.common.synchronization [None req-335b8f04-22eb-454c-ae2f-dddaa3a28b32 None None] Enqueued Resource ID: 69762379-341e-4f8f-92d1-128759e2ddc9 with Priority: HIGHEST for action port [ 1123.613503] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69762379-341e-4f8f-92d1-128759e2ddc9 with Priority: HIGHEST for action port [ 1123.613701] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-69762379-341e-4f8f-92d1-128759e2ddc9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.613823] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69762379-341e-4f8f-92d1-128759e2ddc9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.613889] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69762379-341e-4f8f-92d1-128759e2ddc9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.616151] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69762379-341e-4f8f-92d1-128759e2ddc9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.616407] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69762379-341e-4f8f-92d1-128759e2ddc9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.119143] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69762379-341e-4f8f-92d1-128759e2ddc9 [ 1124.120416] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.120416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.120416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.120416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.120416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.120416] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69762379-341e-4f8f-92d1-128759e2ddc9 already deleted. [ 1124.120416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69762379-341e-4f8f-92d1-128759e2ddc9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.185188] env[71140]: INFO networking_nsxv3.common.synchronization [req-551c6f7a-8280-4156-bc65-62caa445d2ee req-49a17f06-b314-4f73-a88e-bb17c39a2267 service nova] Enqueued Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_rules [ 1124.185349] env[71140]: INFO networking_nsxv3.common.synchronization [req-551c6f7a-8280-4156-bc65-62caa445d2ee req-49a17f06-b314-4f73-a88e-bb17c39a2267 service nova] Enqueued Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_members [ 1124.185488] env[71140]: INFO networking_nsxv3.common.synchronization [req-551c6f7a-8280-4156-bc65-62caa445d2ee req-49a17f06-b314-4f73-a88e-bb17c39a2267 service nova] Enqueued Resource ID: da4e1e9b-6b1f-40f4-9bc7-807828d08c47 with Priority: HIGHEST for action port [ 1124.185716] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_rules [ 1124.185839] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_members [ 1124.185928] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4e1e9b-6b1f-40f4-9bc7-807828d08c47 with Priority: HIGHEST for action port [ 1124.186493] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.186846] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.187024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.187284] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.187425] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.188326] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.188568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.188693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.192018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.192018] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.192018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.192018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.192018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.192018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.192018] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.192018] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.192018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.192018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.192018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.192018] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da4e1e9b-6b1f-40f4-9bc7-807828d08c47',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.693852] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.694935] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.695055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.697327] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da4e1e9b-6b1f-40f4-9bc7-807828d08c47 with status ACTIVE [ 1124.697327] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.697327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.697327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.697327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.697327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.697327] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.697327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.697327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.697583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.697583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.697726] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.697815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.697815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.698063] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.698063] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.698147] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da4e1e9b-6b1f-40f4-9bc7-807828d08c47 is going to be updated. [ 1124.719947] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.720184] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.720298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.720559] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.720754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.720952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.197013] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.616356] env[71140]: INFO networking_nsxv3.common.synchronization [None req-5bf19fe7-fe8c-4eb3-93e4-a4a31f3a38b5 None None] Enqueued Resource ID: 0d1a8a13-6ae7-4423-bbb2-fa3dd9656287 with Priority: HIGHEST for action port [ 1125.617276] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d1a8a13-6ae7-4423-bbb2-fa3dd9656287 with Priority: HIGHEST for action port [ 1125.617370] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d1a8a13-6ae7-4423-bbb2-fa3dd9656287 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.617814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d1a8a13-6ae7-4423-bbb2-fa3dd9656287" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.617814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d1a8a13-6ae7-4423-bbb2-fa3dd9656287" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.618115] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d1a8a13-6ae7-4423-bbb2-fa3dd9656287" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.618178] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d1a8a13-6ae7-4423-bbb2-fa3dd9656287',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.699643] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.702517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.702598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.702820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.702914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.703036] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 is going to be created. [ 1125.763298] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.763298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.763298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.763488] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.763780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.772401] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: UNINITIALIZED for 2s [ 1126.120413] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d1a8a13-6ae7-4423-bbb2-fa3dd9656287 [ 1126.120859] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.120859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.120859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.121381] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.121532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.121634] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d1a8a13-6ae7-4423-bbb2-fa3dd9656287 already deleted. [ 1126.121714] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d1a8a13-6ae7-4423-bbb2-fa3dd9656287" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.407142] env[71140]: INFO networking_nsxv3.common.synchronization [req-35730ad0-fa9c-4ccf-94ab-9197781c13d0 req-30ddfca5-43a2-4ef4-b87a-63100b28a1d3 tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_members [ 1126.407794] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_members [ 1126.411017] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-83375852-3b13-42bc-b95c-09c5949dc69a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.411017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.411017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.411017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.411017] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.411017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.411017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.411017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.411017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.411017] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.742978] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-941 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.742978] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.742978] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.742978] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.742978] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.742978] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.742978] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.742978] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.744069] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.744428] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1126.744697] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1126.744945] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1126.745572] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1126.745839] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1126.746067] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1126.746590] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1126.766020] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1126.766020] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1126.766020] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1126.766020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.766020] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-55d1dd15-0d46-429b-ac3d-dbb22b70e453 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.766020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-55d1dd15-0d46-429b-ac3d-dbb22b70e453" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.766020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-55d1dd15-0d46-429b-ac3d-dbb22b70e453" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.766020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-55d1dd15-0d46-429b-ac3d-dbb22b70e453" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.766020] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55d1dd15-0d46-429b-ac3d-dbb22b70e453',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.915101] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.915234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.915289] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.915971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.916306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.916446] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.916688] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.916688] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.916816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.916867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.917149] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83375852-3b13-42bc-b95c-09c5949dc69a already deleted. [ 1126.917256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.272020] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.272020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.272020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.272020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.272020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.272020] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 55d1dd15-0d46-429b-ac3d-dbb22b70e453 not found, creating... [ 1127.272020] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.272020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.272020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.272020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.272444] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.272444] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.273288] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.273619] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.273980] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.274270] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.274538] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 55d1dd15-0d46-429b-ac3d-dbb22b70e453 is going to be created. [ 1127.300266] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.300266] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.300266] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.300266] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.300266] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.300266] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-55d1dd15-0d46-429b-ac3d-dbb22b70e453" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.418434] env[71140]: INFO networking_nsxv3.common.synchronization [None req-dde01ed1-78e0-45fa-8f95-490aca0ac845 None None] Enqueued Resource ID: 3d881d5f-3557-4444-a6ef-74491dc7ab3d with Priority: HIGHEST for action port [ 1127.418434] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d881d5f-3557-4444-a6ef-74491dc7ab3d with Priority: HIGHEST for action port [ 1127.418434] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d881d5f-3557-4444-a6ef-74491dc7ab3d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.418434] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d881d5f-3557-4444-a6ef-74491dc7ab3d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.418434] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d881d5f-3557-4444-a6ef-74491dc7ab3d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.418434] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d881d5f-3557-4444-a6ef-74491dc7ab3d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.418434] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d881d5f-3557-4444-a6ef-74491dc7ab3d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.784494] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: SUCCESS [ 1127.784813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.784918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.785211] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.785426] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.785546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.785613] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.785766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.785844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.785927] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.786029] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.921664] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d881d5f-3557-4444-a6ef-74491dc7ab3d [ 1127.922809] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.922809] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.922809] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.922809] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.922809] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.922809] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d881d5f-3557-4444-a6ef-74491dc7ab3d already deleted. [ 1127.922809] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d881d5f-3557-4444-a6ef-74491dc7ab3d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.069022] env[71140]: INFO networking_nsxv3.common.synchronization [req-35730ad0-fa9c-4ccf-94ab-9197781c13d0 req-aa6af55d-c784-42fd-8a46-8fe709895c71 service nova] Enqueued Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_rules [ 1128.069196] env[71140]: INFO networking_nsxv3.common.synchronization [req-35730ad0-fa9c-4ccf-94ab-9197781c13d0 req-aa6af55d-c784-42fd-8a46-8fe709895c71 service nova] Enqueued Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_members [ 1128.069347] env[71140]: INFO networking_nsxv3.common.synchronization [req-35730ad0-fa9c-4ccf-94ab-9197781c13d0 req-aa6af55d-c784-42fd-8a46-8fe709895c71 service nova] Enqueued Resource ID: 55d1dd15-0d46-429b-ac3d-dbb22b70e453 with Priority: HIGHEST for action port [ 1128.069627] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_rules [ 1128.069768] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_members [ 1128.069861] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55d1dd15-0d46-429b-ac3d-dbb22b70e453 with Priority: HIGHEST for action port [ 1128.070777] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83375852-3b13-42bc-b95c-09c5949dc69a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.071036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.071504] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.071794] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.071960] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.073073] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-83375852-3b13-42bc-b95c-09c5949dc69a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.073323] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.073439] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.073838] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.074067] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.074281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.074409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.074652] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.074819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.074956] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.075918] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-55d1dd15-0d46-429b-ac3d-dbb22b70e453 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.076096] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55d1dd15-0d46-429b-ac3d-dbb22b70e453" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.076220] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55d1dd15-0d46-429b-ac3d-dbb22b70e453" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.076460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55d1dd15-0d46-429b-ac3d-dbb22b70e453" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.076602] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55d1dd15-0d46-429b-ac3d-dbb22b70e453',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.291031] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.291152] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.291231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.292448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.292448] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.292448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.292448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.292448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.292448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.292448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.292448] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.292448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.292448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.292951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.292951] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.292951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.292951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.292951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.293149] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.293149] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.293205] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.578837] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-83375852-3b13-42bc-b95c-09c5949dc69a taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.578979] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.580137] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.580278] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55d1dd15-0d46-429b-ac3d-dbb22b70e453 with status ACTIVE [ 1128.580415] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.580541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.580687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.580789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.580876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.581065] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.584017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.584017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.584017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.584017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.584017] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.584017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.584017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.584017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.584017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.584017] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55d1dd15-0d46-429b-ac3d-dbb22b70e453 is going to be updated. [ 1128.606128] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.606318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.606431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.606648] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.606795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.606994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55d1dd15-0d46-429b-ac3d-dbb22b70e453" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.795712] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8bf2e04-ddcc-43f4-b665-59a628a61547: rpc.has_security_group_logging(os_id): False [ 1128.815409] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.815574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.815649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.816094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.816094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.816255] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.816351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.816411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.816575] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.816657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.816835] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.816927] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.816988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.817595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.817595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.817595] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.817595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.817595] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.818019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.818019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.818019] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 is going to be created. [ 1128.873139] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.873139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.873249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.873419] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.873598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.883953] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: IN_PROGRESS for 2s [ 1129.084528] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.433041] env[71140]: INFO networking_nsxv3.common.synchronization [None req-462dc49b-7a1e-4401-907e-a206a07dbe7c None None] Enqueued Resource ID: 139eb23f-3682-4803-b1f2-571358137770 with Priority: HIGHEST for action port [ 1129.433314] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 139eb23f-3682-4803-b1f2-571358137770 with Priority: HIGHEST for action port [ 1129.433802] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-139eb23f-3682-4803-b1f2-571358137770 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.434083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-139eb23f-3682-4803-b1f2-571358137770" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.434083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-139eb23f-3682-4803-b1f2-571358137770" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.434344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-139eb23f-3682-4803-b1f2-571358137770" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.434344] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('139eb23f-3682-4803-b1f2-571358137770',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.587941] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.588205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.588205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.588369] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.588458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.588552] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83375852-3b13-42bc-b95c-09c5949dc69a is going to be created. [ 1129.611364] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.611522] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.611575] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.613036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.613036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.621469] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83375852-3b13-42bc-b95c-09c5949dc69a in Status: UNINITIALIZED for 2s [ 1129.938893] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 139eb23f-3682-4803-b1f2-571358137770 [ 1129.939142] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.939239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.939351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.939549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.939661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.939749] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:139eb23f-3682-4803-b1f2-571358137770 already deleted. [ 1129.939828] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-139eb23f-3682-4803-b1f2-571358137770" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.895850] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: SUCCESS [ 1130.896121] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.204062] env[71140]: INFO networking_nsxv3.common.synchronization [None req-27c1c8e7-e9d9-4620-aac4-1db8566f5829 tempest-AttachVolumeNegativeTest-950002537 tempest-AttachVolumeNegativeTest-950002537-project-member] Enqueued Resource ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 with Priority: HIGHEST for action security_group_rules [ 1131.204409] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 with Priority: HIGHEST for action security_group_rules [ 1131.204929] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.205186] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.205355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.205750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.205935] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fe121ab-f6de-4059-bbdf-9b957346a3d3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.302991] env[71140]: INFO networking_nsxv3.common.synchronization [None req-e137bf95-2548-4820-bed3-e51494ea94b5 tempest-AttachVolumeNegativeTest-950002537 tempest-AttachVolumeNegativeTest-950002537-project-member] Enqueued Resource ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 with Priority: HIGHEST for action security_group_rules [ 1131.303838] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 with Priority: HIGHEST for action security_group_rules [ 1131.304294] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.304404] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.638843] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83375852-3b13-42bc-b95c-09c5949dc69a in Status: SUCCESS [ 1131.638988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.639232] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.640812] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.641034] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.641428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.641428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.641428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.641551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.641581] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.642457] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.734752] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.734752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.734752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.735195] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.736272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.736272] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 already deleted. [ 1131.736272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.736272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.736272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.736272] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fe121ab-f6de-4059-bbdf-9b957346a3d3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.143440] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.262770] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.263091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.263091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.263355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.263454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.263549] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 already deleted. [ 1132.263629] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.645625] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83375852-3b13-42bc-b95c-09c5949dc69a: rpc.has_security_group_logging(os_id): False [ 1132.649964] env[71140]: INFO networking_nsxv3.common.synchronization [req-15f7602c-64dc-42d3-bf7b-3aab51bb678b req-04f0bec9-0322-44a3-b456-5d73220e66da tempest-AttachVolumeShelveTestJSON-926657130 tempest-AttachVolumeShelveTestJSON-926657130-project-member] Enqueued Resource ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 with Priority: HIGHEST for action security_group_members [ 1132.650521] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 with Priority: HIGHEST for action security_group_members [ 1132.650913] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.651076] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.651255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.652133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.652356] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.652469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.652543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.652750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.652844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.652949] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f4aefa9-35c0-4c8a-bade-f3a9b8c62528',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.663349] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.663481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.663594] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.663792] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.663890] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.664201] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.664278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.664340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.664499] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.664592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.664689] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83375852-3b13-42bc-b95c-09c5949dc69a is going to be created. [ 1132.719926] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.720115] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.720264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.720432] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.720659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.729989] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83375852-3b13-42bc-b95c-09c5949dc69a in Status: IN_PROGRESS for 2s [ 1132.951623] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.951623] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-600" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.951623] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-600" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.951623] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-600" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.951623] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.952295] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.955718] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.955718] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.955718] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.955718] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.955718] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1132.955718] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1132.955718] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1132.955718] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.955718] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1132.955718] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.970332] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.973018] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1132.973018] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.973018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-600" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.973018] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-82b7d1f8-9039-4fe9-9280-b798fc140b63 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.973018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-82b7d1f8-9039-4fe9-9280-b798fc140b63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.973018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-82b7d1f8-9039-4fe9-9280-b798fc140b63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.973018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-82b7d1f8-9039-4fe9-9280-b798fc140b63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.973018] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82b7d1f8-9039-4fe9-9280-b798fc140b63',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.155661] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.155859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.155935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.156171] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.156278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.156495] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.156606] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.156673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.156834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.156912] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.156999] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 already deleted. [ 1133.157126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.477087] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.477444] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.477483] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.477845] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.478063] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.478250] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 82b7d1f8-9039-4fe9-9280-b798fc140b63 not found, creating... [ 1133.478538] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.478705] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.478848] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.479104] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.479257] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.479553] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.479807] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.480093] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.480383] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.480605] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.480763] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 82b7d1f8-9039-4fe9-9280-b798fc140b63 is going to be created. [ 1133.500321] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.500402] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.500760] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.500876] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.501187] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.501429] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-82b7d1f8-9039-4fe9-9280-b798fc140b63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.713883] env[71140]: INFO networking_nsxv3.common.synchronization [None req-bae64942-a553-4e1a-8d88-561f9b45a97d None None] Enqueued Resource ID: 4c1cd456-a6d8-4a8e-8660-17049c1f5c90 with Priority: HIGHEST for action port [ 1133.717172] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1cd456-a6d8-4a8e-8660-17049c1f5c90 with Priority: HIGHEST for action port [ 1133.717446] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c1cd456-a6d8-4a8e-8660-17049c1f5c90 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.717585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c1cd456-a6d8-4a8e-8660-17049c1f5c90" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.717691] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c1cd456-a6d8-4a8e-8660-17049c1f5c90" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.717965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c1cd456-a6d8-4a8e-8660-17049c1f5c90" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.718086] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c1cd456-a6d8-4a8e-8660-17049c1f5c90',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.202300] env[71140]: INFO networking_nsxv3.common.synchronization [req-15f7602c-64dc-42d3-bf7b-3aab51bb678b req-36068aef-9084-4aa2-b8b1-55497b07a381 service nova] Enqueued Resource ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 with Priority: HIGHEST for action security_group_rules [ 1134.202487] env[71140]: INFO networking_nsxv3.common.synchronization [req-15f7602c-64dc-42d3-bf7b-3aab51bb678b req-36068aef-9084-4aa2-b8b1-55497b07a381 service nova] Enqueued Resource ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 with Priority: HIGHEST for action security_group_members [ 1134.202632] env[71140]: INFO networking_nsxv3.common.synchronization [req-15f7602c-64dc-42d3-bf7b-3aab51bb678b req-36068aef-9084-4aa2-b8b1-55497b07a381 service nova] Enqueued Resource ID: 82b7d1f8-9039-4fe9-9280-b798fc140b63 with Priority: HIGHEST for action port [ 1134.203222] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 with Priority: HIGHEST for action security_group_rules [ 1134.203357] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 with Priority: HIGHEST for action security_group_members [ 1134.203452] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82b7d1f8-9039-4fe9-9280-b798fc140b63 with Priority: HIGHEST for action port [ 1134.203735] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.205965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.205965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.205965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.205965] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f4aefa9-35c0-4c8a-bade-f3a9b8c62528',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.205965] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.205965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.205965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.205965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.205965] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.205965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.205965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.205965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.205965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.206705] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f4aefa9-35c0-4c8a-bade-f3a9b8c62528',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.206754] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-82b7d1f8-9039-4fe9-9280-b798fc140b63 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.206825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82b7d1f8-9039-4fe9-9280-b798fc140b63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.206892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82b7d1f8-9039-4fe9-9280-b798fc140b63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.208251] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82b7d1f8-9039-4fe9-9280-b798fc140b63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.208343] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82b7d1f8-9039-4fe9-9280-b798fc140b63',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.221607] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c1cd456-a6d8-4a8e-8660-17049c1f5c90 [ 1134.224080] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.224080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.224080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.224080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.224080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.224080] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c1cd456-a6d8-4a8e-8660-17049c1f5c90 already deleted. [ 1134.224080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c1cd456-a6d8-4a8e-8660-17049c1f5c90" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.709613] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f4aefa9-35c0-4c8a-bade-f3a9b8c62528',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.710626] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.710626] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.710626] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82b7d1f8-9039-4fe9-9280-b798fc140b63 with status ACTIVE [ 1134.711310] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.711310] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.711310] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.711310] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.711310] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.711612] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.711612] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.711612] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.711796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.711796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.715143] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.715143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.715143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.715143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.715143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.715143] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82b7d1f8-9039-4fe9-9280-b798fc140b63 is going to be updated. [ 1134.732490] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.732490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.732490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.732705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.732835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.732993] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82b7d1f8-9039-4fe9-9280-b798fc140b63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.742400] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83375852-3b13-42bc-b95c-09c5949dc69a in Status: SUCCESS [ 1134.742621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.216026] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f4aefa9-35c0-4c8a-bade-f3a9b8c62528',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.716932] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.717407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.717407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.717518] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.717518] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.717613] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 is going to be created. [ 1135.740054] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.740054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.740054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.740054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.740054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.744552] env[71140]: INFO networking_nsxv3.common.synchronization [None req-06a5016e-b375-49f6-95c1-56d3e20c079d None None] Enqueued Resource ID: 8a76ead8-38da-4811-b699-042d84ed6f92 with Priority: HIGHEST for action port [ 1135.744870] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a76ead8-38da-4811-b699-042d84ed6f92 with Priority: HIGHEST for action port [ 1135.746194] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a76ead8-38da-4811-b699-042d84ed6f92 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.746340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a76ead8-38da-4811-b699-042d84ed6f92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.746401] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a76ead8-38da-4811-b699-042d84ed6f92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.747442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a76ead8-38da-4811-b699-042d84ed6f92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.747442] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a76ead8-38da-4811-b699-042d84ed6f92',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.754040] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 in Status: UNINITIALIZED for 2s [ 1136.248806] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a76ead8-38da-4811-b699-042d84ed6f92 [ 1136.249099] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.249543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.249687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.249994] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.250137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.250259] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a76ead8-38da-4811-b699-042d84ed6f92 already deleted. [ 1136.250367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a76ead8-38da-4811-b699-042d84ed6f92" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.389538] env[71140]: INFO networking_nsxv3.common.synchronization [None req-accd8dbe-9079-4110-b5dd-3cc283df079c None None] Enqueued Resource ID: dfb3c78d-dbf3-4f63-a509-09a02435419b with Priority: HIGHEST for action port [ 1136.389538] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfb3c78d-dbf3-4f63-a509-09a02435419b with Priority: HIGHEST for action port [ 1136.389538] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfb3c78d-dbf3-4f63-a509-09a02435419b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.389538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfb3c78d-dbf3-4f63-a509-09a02435419b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.389538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfb3c78d-dbf3-4f63-a509-09a02435419b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.389538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfb3c78d-dbf3-4f63-a509-09a02435419b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.389538] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfb3c78d-dbf3-4f63-a509-09a02435419b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.888549] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfb3c78d-dbf3-4f63-a509-09a02435419b [ 1136.888806] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.888904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.889096] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.889547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.889647] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.889817] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfb3c78d-dbf3-4f63-a509-09a02435419b already deleted. [ 1136.889936] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfb3c78d-dbf3-4f63-a509-09a02435419b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.764937] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 in Status: SUCCESS [ 1137.765170] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.765343] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.765546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.765728] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.765842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.765904] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.766061] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.766138] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.766219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.766372] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f4aefa9-35c0-4c8a-bade-f3a9b8c62528',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.270224] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f4aefa9-35c0-4c8a-bade-f3a9b8c62528',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.531460] env[71140]: INFO networking_nsxv3.common.synchronization [None req-76720446-abdc-48b4-b2c6-94cc885bbaaf None None] Enqueued Resource ID: 16987992-fb89-4412-9dbd-50bd48f1e0ef with Priority: HIGHEST for action port [ 1138.534376] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16987992-fb89-4412-9dbd-50bd48f1e0ef with Priority: HIGHEST for action port [ 1138.534735] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-16987992-fb89-4412-9dbd-50bd48f1e0ef taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.534843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16987992-fb89-4412-9dbd-50bd48f1e0ef" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.534913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16987992-fb89-4412-9dbd-50bd48f1e0ef" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.535230] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16987992-fb89-4412-9dbd-50bd48f1e0ef" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.535287] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16987992-fb89-4412-9dbd-50bd48f1e0ef',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.772341] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528: rpc.has_security_group_logging(os_id): False [ 1138.790758] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.790999] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.791372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.791460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.791574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.792012] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.792111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.792154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.792380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.792501] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.792603] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 is going to be created. [ 1138.854464] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.854617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.854691] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.854911] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.855127] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.866877] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 in Status: IN_PROGRESS for 2s [ 1139.038270] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16987992-fb89-4412-9dbd-50bd48f1e0ef [ 1139.038523] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.038661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.038733] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.038972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.039065] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.039169] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16987992-fb89-4412-9dbd-50bd48f1e0ef already deleted. [ 1139.039267] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16987992-fb89-4412-9dbd-50bd48f1e0ef" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.880024] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 in Status: SUCCESS [ 1140.880293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.362156] env[71140]: INFO networking_nsxv3.common.synchronization [req-ea274bbd-a3da-404e-b234-f6aa7be2120c req-6ed27225-3b9e-4075-b704-adb23f97c791 tempest-DeleteServersTestJSON-1199867382 tempest-DeleteServersTestJSON-1199867382-project-member] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1143.362156] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1143.362156] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.362156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.362156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.362156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.362156] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.362156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.362156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.362156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.362156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.362156] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.672246] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-351 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.672246] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.672246] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.672550] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.672847] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.673116] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.673319] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.673730] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.674027] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.674187] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.674492] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.674693] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.675009] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.675082] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.675239] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.675695] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.695814] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.695910] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1143.696102] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.696387] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-351" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.697026] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-6d53de37-0842-4afe-b38c-25a593595423 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.697201] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-6d53de37-0842-4afe-b38c-25a593595423" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.697406] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-6d53de37-0842-4afe-b38c-25a593595423" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.697814] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-6d53de37-0842-4afe-b38c-25a593595423" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.698750] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d53de37-0842-4afe-b38c-25a593595423',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.865185] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.865185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.865185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.865185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.865185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.865506] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.865559] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.865603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.865756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.865839] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.865927] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be deleted. [ 1143.894536] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.894536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.894536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.894536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.894536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.894536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.201763] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.201897] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.201939] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.202257] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.202422] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.202586] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 6d53de37-0842-4afe-b38c-25a593595423 not found, creating... [ 1144.202856] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.203033] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.203158] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.203384] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.203524] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.203806] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.203964] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.204134] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.204352] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.204707] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.204707] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 6d53de37-0842-4afe-b38c-25a593595423 is going to be created. [ 1144.225431] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.225654] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.225783] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.226086] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.226984] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.226984] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-6d53de37-0842-4afe-b38c-25a593595423" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.979571] env[71140]: INFO networking_nsxv3.common.synchronization [req-ea274bbd-a3da-404e-b234-f6aa7be2120c req-336b3395-d774-429f-aab0-3272805484ea service nova] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_rules [ 1144.979940] env[71140]: INFO networking_nsxv3.common.synchronization [req-ea274bbd-a3da-404e-b234-f6aa7be2120c req-336b3395-d774-429f-aab0-3272805484ea service nova] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1144.981202] env[71140]: INFO networking_nsxv3.common.synchronization [req-ea274bbd-a3da-404e-b234-f6aa7be2120c req-336b3395-d774-429f-aab0-3272805484ea service nova] Enqueued Resource ID: 6d53de37-0842-4afe-b38c-25a593595423 with Priority: HIGHEST for action port [ 1144.981543] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_rules [ 1144.981731] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1144.981876] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d53de37-0842-4afe-b38c-25a593595423 with Priority: HIGHEST for action port [ 1144.984795] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.984795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.984795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.984982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.985119] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.986590] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.989169] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.989289] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.989568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.989778] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.989945] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.991931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.991931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.991931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.992053] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.993080] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d53de37-0842-4afe-b38c-25a593595423 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.993080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d53de37-0842-4afe-b38c-25a593595423" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.993080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d53de37-0842-4afe-b38c-25a593595423" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.993519] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d53de37-0842-4afe-b38c-25a593595423" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.993519] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d53de37-0842-4afe-b38c-25a593595423',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.495706] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.495906] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.496202] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.497378] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d53de37-0842-4afe-b38c-25a593595423 with status ACTIVE [ 1145.497643] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.497807] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.497922] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.498245] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.498384] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.498649] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.498934] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.499043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.499305] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.499409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.499691] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.499843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.500082] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.500243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.500367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.500577] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d53de37-0842-4afe-b38c-25a593595423 is going to be updated. [ 1145.521647] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.521795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.521867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.522094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.522234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.522388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d53de37-0842-4afe-b38c-25a593595423" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.003434] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.505977] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.506223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.506389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.506697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.506796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.506900] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be created. [ 1146.529551] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.529677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.529722] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.529967] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.530156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.544678] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: UNINITIALIZED for 2s [ 1146.680867] env[71140]: INFO networking_nsxv3.common.synchronization [req-ee0c9c50-0cb7-49a4-9ef0-70908cac9752 req-002aa593-43e6-4dcc-8423-39356f837d1c tempest-ServerRescueTestJSONUnderV235-49877120 tempest-ServerRescueTestJSONUnderV235-49877120-project-member] Enqueued Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_members [ 1146.681412] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_members [ 1146.681733] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ddcb2b-491d-450f-80bc-7c6250b005e1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.681854] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.681918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.682341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.682443] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.682520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.682568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.682681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.682764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.682853] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.043286] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-629 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.043641] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-629" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.043641] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-629" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.044096] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-629" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.044471] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.044708] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.044868] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.045156] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.045349] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.045795] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.045795] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.045885] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.045943] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.046150] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.046299] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.046477] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1147.065926] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1147.065926] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1147.065926] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1147.066085] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-629" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.067066] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-c676dba9-4f99-470a-86bf-42a06945b1b8 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.067066] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-c676dba9-4f99-470a-86bf-42a06945b1b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.067066] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-c676dba9-4f99-470a-86bf-42a06945b1b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.067066] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-c676dba9-4f99-470a-86bf-42a06945b1b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.067299] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c676dba9-4f99-470a-86bf-42a06945b1b8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.185395] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.185605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.185682] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.185991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.186138] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.186430] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.186557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.186671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.186869] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.186967] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.187091] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 already deleted. [ 1147.187179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.570343] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.570989] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.572179] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.572179] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.572179] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.572179] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port c676dba9-4f99-470a-86bf-42a06945b1b8 not found, creating... [ 1147.572179] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.572543] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.572720] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.573021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.573247] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.573655] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.574836] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.574836] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.574836] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.574836] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.574836] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: c676dba9-4f99-470a-86bf-42a06945b1b8 is going to be created. [ 1147.595635] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.595761] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.595834] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.596140] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.596402] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.596609] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-c676dba9-4f99-470a-86bf-42a06945b1b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.288963] env[71140]: INFO networking_nsxv3.common.synchronization [req-ee0c9c50-0cb7-49a4-9ef0-70908cac9752 req-8718271e-a632-4903-84ba-4989aee70657 service nova] Enqueued Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_rules [ 1148.289217] env[71140]: INFO networking_nsxv3.common.synchronization [req-ee0c9c50-0cb7-49a4-9ef0-70908cac9752 req-8718271e-a632-4903-84ba-4989aee70657 service nova] Enqueued Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_members [ 1148.289323] env[71140]: INFO networking_nsxv3.common.synchronization [req-ee0c9c50-0cb7-49a4-9ef0-70908cac9752 req-8718271e-a632-4903-84ba-4989aee70657 service nova] Enqueued Resource ID: c676dba9-4f99-470a-86bf-42a06945b1b8 with Priority: HIGHEST for action port [ 1148.289614] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_rules [ 1148.289673] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_members [ 1148.289755] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c676dba9-4f99-470a-86bf-42a06945b1b8 with Priority: HIGHEST for action port [ 1148.290536] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4ddcb2b-491d-450f-80bc-7c6250b005e1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.290726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.290840] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.291247] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.291380] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.294623] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ddcb2b-491d-450f-80bc-7c6250b005e1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.294623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.294623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.294623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.294623] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.294623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.294623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.294623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.294623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.294623] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.296179] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-c676dba9-4f99-470a-86bf-42a06945b1b8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.296179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c676dba9-4f99-470a-86bf-42a06945b1b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.296179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c676dba9-4f99-470a-86bf-42a06945b1b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.296418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c676dba9-4f99-470a-86bf-42a06945b1b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.296660] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c676dba9-4f99-470a-86bf-42a06945b1b8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.554771] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 1148.555059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.555670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.555921] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.556172] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.556325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.556402] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.556569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.556661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.556736] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.556829] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.798844] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ddcb2b-491d-450f-80bc-7c6250b005e1 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.799044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.799338] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.800332] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c676dba9-4f99-470a-86bf-42a06945b1b8 with status ACTIVE [ 1148.800520] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.800650] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.800811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.802166] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.802166] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.802166] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.802166] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.802166] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.802453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.802453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.802650] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.802712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.802741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.802862] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.802934] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.803030] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c676dba9-4f99-470a-86bf-42a06945b1b8 is going to be updated. [ 1148.823033] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.823233] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.823233] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.823514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.823637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.823723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c676dba9-4f99-470a-86bf-42a06945b1b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.060510] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.060739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.060739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.061011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.061274] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.061413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.061485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.061667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.061761] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.061852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.062017] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.062120] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.062180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.062342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.062530] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.062635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.062703] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.062876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.062964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.063485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.063605] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.141091] env[71140]: INFO networking_nsxv3.common.synchronization [req-26e93020-0a0c-489a-a967-03ebd3f549d9 req-75b75111-14be-4af6-afe4-b69803d64fb2 tempest-ServerActionsTestOtherB-2025667431 tempest-ServerActionsTestOtherB-2025667431-project-member] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 1149.141714] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 1149.142516] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.142715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.142775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.142966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.143177] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.143295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.143368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.143522] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.143608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.143702] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.306348] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.461732] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.461868] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.461912] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.463200] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.463200] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.463200] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.463200] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.463200] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.463200] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.463524] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1149.463640] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1149.463680] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1149.463782] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1149.463892] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1149.463998] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1149.464155] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1149.483318] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1149.483477] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1149.483616] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1149.483789] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.484125] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.484296] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.484416] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.484737] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.484874] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d01f9eba-f429-41fe-b9c7-0f3249ed16e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.565860] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c549bd3-468a-4655-b709-3480ff374e11: rpc.has_security_group_logging(os_id): False [ 1149.584170] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.584329] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.584386] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.584610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.584702] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.584930] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.585063] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.585133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.585325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.585532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.585532] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.585816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.585816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.585816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.585950] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.586116] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.586219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.586219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.586369] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.586415] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.586497] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be created. [ 1149.647583] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.647808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.647944] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.648272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.648458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.648769] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.648927] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.649067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.649300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.649403] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.649519] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c is going to be deleted. [ 1149.651556] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.651667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.651726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.651878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.652071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.668344] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 1149.682578] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.682739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.682781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.682974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.683080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.683184] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.809476] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.809808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.810016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.810464] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.810671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.810905] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 is going to be created. [ 1149.836873] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.837080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.837126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.837381] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.838035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.846891] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 in Status: UNINITIALIZED for 2s [ 1149.987350] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.987587] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.987721] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.988285] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.988373] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.988546] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port d01f9eba-f429-41fe-b9c7-0f3249ed16e1 not found, creating... [ 1149.988837] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.989635] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.989635] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.989635] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.989635] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.989842] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.990078] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.990220] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.990457] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.990605] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.990755] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: d01f9eba-f429-41fe-b9c7-0f3249ed16e1 is going to be created. [ 1150.018466] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.018466] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.018466] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.018656] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.018790] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.019583] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.691810] env[71140]: INFO networking_nsxv3.common.synchronization [req-26e93020-0a0c-489a-a967-03ebd3f549d9 req-ebe9b25e-18fe-409c-acf9-829c3341e42d service nova] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_rules [ 1150.691810] env[71140]: INFO networking_nsxv3.common.synchronization [req-26e93020-0a0c-489a-a967-03ebd3f549d9 req-ebe9b25e-18fe-409c-acf9-829c3341e42d service nova] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 1150.692142] env[71140]: INFO networking_nsxv3.common.synchronization [req-26e93020-0a0c-489a-a967-03ebd3f549d9 req-ebe9b25e-18fe-409c-acf9-829c3341e42d service nova] Enqueued Resource ID: d01f9eba-f429-41fe-b9c7-0f3249ed16e1 with Priority: HIGHEST for action port [ 1150.692708] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_rules [ 1150.692708] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 1150.692889] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d01f9eba-f429-41fe-b9c7-0f3249ed16e1 with Priority: HIGHEST for action port [ 1150.693021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.694215] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.694215] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.694407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.694467] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.695997] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.695997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.695997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.695997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.700021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.700021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.700021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.700021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.700021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.700021] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.700021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.700021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.700021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.700021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.700021] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d01f9eba-f429-41fe-b9c7-0f3249ed16e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.204055] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d01f9eba-f429-41fe-b9c7-0f3249ed16e1 with status ACTIVE [ 1151.204055] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.204055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.204055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.204055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.204055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.204055] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.204055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.204055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.204055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.204055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.204055] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.204511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.204511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.204511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.204511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.204511] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d01f9eba-f429-41fe-b9c7-0f3249ed16e1 is going to be updated. [ 1151.205535] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.206355] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.206438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.224773] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.224917] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.224990] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.225210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.225343] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.225501] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.670018] env[71140]: INFO networking_nsxv3.common.synchronization [req-693f07e1-8785-4568-95e2-13767ac79a54 req-f6ecb6e0-8399-42aa-a8c6-8a6794f9b6bd tempest-AttachInterfacesV270Test-171536725 tempest-AttachInterfacesV270Test-171536725-project-member] Enqueued Resource ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 with Priority: HIGHEST for action security_group_members [ 1151.671882] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 with Priority: HIGHEST for action security_group_members [ 1151.675021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e010a3d8-12ba-4790-bd4e-82c0e5662a99 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.675021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.675021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.675021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.675021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.675021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.675021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.675021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.675021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.675021] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e010a3d8-12ba-4790-bd4e-82c0e5662a99',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.685749] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 1151.685749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.708890] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.857323] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 in Status: SUCCESS [ 1151.857602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.857766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.857981] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.858192] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.858315] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.858382] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.858533] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.858622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.858711] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.858811] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.965890] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.966151] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-988" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.966292] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-988" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.966620] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-988" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.966909] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.967213] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.967365] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.967596] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.967751] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.968025] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1151.968128] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1151.968250] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1151.968364] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1151.968483] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1151.968594] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1151.968731] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1151.985358] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1151.985522] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1151.985662] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1151.985830] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-988" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.986136] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-494c2705-f918-41d3-850f-28347657df58 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.986304] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-494c2705-f918-41d3-850f-28347657df58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.986428] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-494c2705-f918-41d3-850f-28347657df58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.986724] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-494c2705-f918-41d3-850f-28347657df58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.986874] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('494c2705-f918-41d3-850f-28347657df58',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.179174] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.179349] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.179409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.179610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.179700] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.179895] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.180033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.180089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.180252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.180331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.180741] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 already deleted. [ 1152.180856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.211536] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.211698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.211770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.211995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.212111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.212214] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c is going to be created. [ 1152.247862] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.248068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.248184] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.248449] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.248635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.257608] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: UNINITIALIZED for 2s [ 1152.363837] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ddcb2b-491d-450f-80bc-7c6250b005e1 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.364050] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.364133] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.364399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.364591] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.364715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.364775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.364962] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.365071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.365258] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.365341] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ddcb2b-491d-450f-80bc-7c6250b005e1 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.365397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.365464] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.365692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.365869] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.365983] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.366066] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.366242] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.366338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.366435] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.366531] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.489946] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.490480] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.490660] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.490964] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.491772] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.491772] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 494c2705-f918-41d3-850f-28347657df58 not found, creating... [ 1152.491772] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.491994] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.492083] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.492626] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.492626] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.492809] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.492969] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.493383] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.493383] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.493517] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.493650] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 494c2705-f918-41d3-850f-28347657df58 is going to be created. [ 1152.514542] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.514698] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.515010] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.515431] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.515694] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.515929] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-494c2705-f918-41d3-850f-28347657df58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.869249] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4ddcb2b-491d-450f-80bc-7c6250b005e1: rpc.has_security_group_logging(os_id): False [ 1152.885769] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.885922] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.885965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.886191] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.886283] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.886469] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.886569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.886634] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.886788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.886865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.887062] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.887161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.887222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.887362] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.887438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.887629] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.887735] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.887797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.888070] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.888187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.888286] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 is going to be created. [ 1152.937257] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.937412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.937462] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.937686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.937869] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.948911] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 in Status: IN_PROGRESS for 2s [ 1153.237643] env[71140]: INFO networking_nsxv3.common.synchronization [req-693f07e1-8785-4568-95e2-13767ac79a54 req-d8290565-1245-45b1-b56d-6701fe4bab41 service nova] Enqueued Resource ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 with Priority: HIGHEST for action security_group_rules [ 1153.237831] env[71140]: INFO networking_nsxv3.common.synchronization [req-693f07e1-8785-4568-95e2-13767ac79a54 req-d8290565-1245-45b1-b56d-6701fe4bab41 service nova] Enqueued Resource ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 with Priority: HIGHEST for action security_group_members [ 1153.237975] env[71140]: INFO networking_nsxv3.common.synchronization [req-693f07e1-8785-4568-95e2-13767ac79a54 req-d8290565-1245-45b1-b56d-6701fe4bab41 service nova] Enqueued Resource ID: 494c2705-f918-41d3-850f-28347657df58 with Priority: HIGHEST for action port [ 1153.244271] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 with Priority: HIGHEST for action security_group_rules [ 1153.244417] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 with Priority: HIGHEST for action security_group_members [ 1153.244515] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494c2705-f918-41d3-850f-28347657df58 with Priority: HIGHEST for action port [ 1153.244797] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e010a3d8-12ba-4790-bd4e-82c0e5662a99 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.244922] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.244990] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.245279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.245366] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e010a3d8-12ba-4790-bd4e-82c0e5662a99',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.251749] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e010a3d8-12ba-4790-bd4e-82c0e5662a99 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.251749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.251749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.251749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.251749] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.251749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.251749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.251749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.251749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.251749] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e010a3d8-12ba-4790-bd4e-82c0e5662a99',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.251749] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-494c2705-f918-41d3-850f-28347657df58 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.251749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-494c2705-f918-41d3-850f-28347657df58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.251749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-494c2705-f918-41d3-850f-28347657df58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.251749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-494c2705-f918-41d3-850f-28347657df58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.251749] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('494c2705-f918-41d3-850f-28347657df58',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.754579] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e010a3d8-12ba-4790-bd4e-82c0e5662a99',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.755843] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e010a3d8-12ba-4790-bd4e-82c0e5662a99 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.756114] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.756517] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 494c2705-f918-41d3-850f-28347657df58 with status ACTIVE [ 1153.756768] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.756946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.757093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.757378] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.757550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.757799] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.757993] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.758183] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.758403] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.758570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.758806] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.758983] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.759116] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.759333] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.759463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.759628] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 494c2705-f918-41d3-850f-28347657df58 is going to be updated. [ 1153.778848] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.778990] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.779094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.779324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.779460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.779644] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-494c2705-f918-41d3-850f-28347657df58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.868300] env[71140]: INFO networking_nsxv3.common.synchronization [req-fee05c8b-a80a-4510-9804-06d232a39a06 req-68685504-77e8-4887-b4cf-7b91b3670587 tempest-AttachVolumeNegativeTest-950002537 tempest-AttachVolumeNegativeTest-950002537-project-member] Enqueued Resource ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 with Priority: HIGHEST for action security_group_members [ 1153.868836] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 with Priority: HIGHEST for action security_group_members [ 1153.869157] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fe121ab-f6de-4059-bbdf-9b957346a3d3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.869268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.869592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.869592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.869750] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.869855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.869855] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.870027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.870180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.870271] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fe121ab-f6de-4059-bbdf-9b957346a3d3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.195296] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-838 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.196018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-838" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.196018] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-838" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.196214] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-838" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.196642] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.196916] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.197137] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.197457] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.198324] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.198324] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1154.198324] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1154.198324] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1154.198324] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1154.198324] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1154.198648] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1154.198648] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1154.216650] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1154.216748] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1154.216898] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1154.217084] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-838" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.217384] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-8bd80ea8-0ae5-40f4-958d-c3e92689a9b3 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.218747] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-8bd80ea8-0ae5-40f4-958d-c3e92689a9b3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.218747] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-8bd80ea8-0ae5-40f4-958d-c3e92689a9b3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.218747] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-8bd80ea8-0ae5-40f4-958d-c3e92689a9b3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.218747] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bd80ea8-0ae5-40f4-958d-c3e92689a9b3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.257488] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e010a3d8-12ba-4790-bd4e-82c0e5662a99',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.267040] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: SUCCESS [ 1154.267040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.267040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.267040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.267040] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.267040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.267040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.267410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.267410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.267410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.267410] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.371904] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.372119] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.372218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.372491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.372609] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.372847] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.372997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.373094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.373293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.373426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.373546] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 already deleted. [ 1154.373676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.720227] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.720750] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.720955] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.721270] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.721563] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.721634] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 8bd80ea8-0ae5-40f4-958d-c3e92689a9b3 not found, creating... [ 1154.721852] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.722101] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.722221] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.722660] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.722810] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.723139] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.723653] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.723653] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.723653] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.723918] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.723918] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 8bd80ea8-0ae5-40f4-958d-c3e92689a9b3 is going to be created. [ 1154.742408] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.742953] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.743118] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.743407] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.743650] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.743894] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-8bd80ea8-0ae5-40f4-958d-c3e92689a9b3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.759998] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.760260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.760260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.760485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.760572] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.760671] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 is going to be created. [ 1154.769444] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.782816] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.782816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.782816] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.783050] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.783204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.792472] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 in Status: UNINITIALIZED for 2s [ 1154.960099] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 in Status: SUCCESS [ 1154.960399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.271602] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c99ec8b-0259-4916-a240-54938fc5a81c: rpc.has_security_group_logging(os_id): False [ 1155.294809] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.294937] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.295752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.295752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.295752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.295752] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.295752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.295752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.296116] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.296116] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.296116] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c is going to be created. [ 1155.373410] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.373568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.373621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.374142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.374142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.384130] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: IN_PROGRESS for 2s [ 1155.962014] env[71140]: INFO networking_nsxv3.common.synchronization [req-fee05c8b-a80a-4510-9804-06d232a39a06 req-e1623036-6ccc-408e-8853-d7a383f91935 service nova] Enqueued Resource ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 with Priority: HIGHEST for action security_group_rules [ 1155.962319] env[71140]: INFO networking_nsxv3.common.synchronization [req-fee05c8b-a80a-4510-9804-06d232a39a06 req-e1623036-6ccc-408e-8853-d7a383f91935 service nova] Enqueued Resource ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 with Priority: HIGHEST for action security_group_members [ 1155.962417] env[71140]: INFO networking_nsxv3.common.synchronization [req-fee05c8b-a80a-4510-9804-06d232a39a06 req-e1623036-6ccc-408e-8853-d7a383f91935 service nova] Enqueued Resource ID: 8bd80ea8-0ae5-40f4-958d-c3e92689a9b3 with Priority: HIGHEST for action port [ 1155.962946] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 with Priority: HIGHEST for action security_group_rules [ 1155.963109] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 with Priority: HIGHEST for action security_group_members [ 1155.963205] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bd80ea8-0ae5-40f4-958d-c3e92689a9b3 with Priority: HIGHEST for action port [ 1155.963490] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.963649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.963722] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.963857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.963938] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fe121ab-f6de-4059-bbdf-9b957346a3d3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.964801] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fe121ab-f6de-4059-bbdf-9b957346a3d3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.968202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.968288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.968499] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.968697] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.968806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.968899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.969078] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.969192] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.969282] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fe121ab-f6de-4059-bbdf-9b957346a3d3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.970571] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bd80ea8-0ae5-40f4-958d-c3e92689a9b3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.970571] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bd80ea8-0ae5-40f4-958d-c3e92689a9b3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.970659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bd80ea8-0ae5-40f4-958d-c3e92689a9b3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.970785] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bd80ea8-0ae5-40f4-958d-c3e92689a9b3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.970860] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bd80ea8-0ae5-40f4-958d-c3e92689a9b3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.180544] env[71140]: INFO networking_nsxv3.common.synchronization [req-1adda4cc-55c6-4701-9297-ba98035eccff req-2919107e-a646-47c9-90e9-1d88bcbcad06 tempest-ServersNegativeTestJSON-651441888 tempest-ServersNegativeTestJSON-651441888-project-member] Enqueued Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_members [ 1156.181271] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_members [ 1156.181658] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.181811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.181901] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.182174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.182645] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.182825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.182916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.183160] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.183278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.183408] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.472188] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fe121ab-f6de-4059-bbdf-9b957346a3d3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.473244] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fe121ab-f6de-4059-bbdf-9b957346a3d3 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.473367] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.473523] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8bd80ea8-0ae5-40f4-958d-c3e92689a9b3 with status ACTIVE [ 1156.473695] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.473777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.473843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.474136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.474310] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.474499] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.474629] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.474685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.474848] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.474923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.475130] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.475237] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.475297] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.475435] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.475508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.475590] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8bd80ea8-0ae5-40f4-958d-c3e92689a9b3 is going to be updated. [ 1156.495977] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.496177] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.496177] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.496956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.496956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.496956] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bd80ea8-0ae5-40f4-958d-c3e92689a9b3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.531771] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-210 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.531906] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-210" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.532022] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-210" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.532297] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-210" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.532560] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.532734] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.532854] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.533085] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.533235] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.533450] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1156.533568] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1156.533679] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1156.533789] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1156.533899] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1156.534017] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1156.534161] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1156.556125] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1156.556314] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1156.556457] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1156.556637] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-210" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.557196] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-eb19c26f-1014-46fe-931c-d0d0f41c241e taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.557196] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-eb19c26f-1014-46fe-931c-d0d0f41c241e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.557416] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-eb19c26f-1014-46fe-931c-d0d0f41c241e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.557588] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-eb19c26f-1014-46fe-931c-d0d0f41c241e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.557732] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb19c26f-1014-46fe-931c-d0d0f41c241e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.685809] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.801426] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 in Status: SUCCESS [ 1156.801426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.801557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.801769] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.802882] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.802882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.802882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.802882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.802882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.802882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.802882] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e010a3d8-12ba-4790-bd4e-82c0e5662a99',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.977693] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fe121ab-f6de-4059-bbdf-9b957346a3d3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.061128] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.061128] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.061128] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.061340] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.061398] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.062093] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port eb19c26f-1014-46fe-931c-d0d0f41c241e not found, creating... [ 1157.062093] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.062093] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.062093] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.062323] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.062467] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.062763] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.062925] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.063062] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.063274] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.063414] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.063555] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: eb19c26f-1014-46fe-931c-d0d0f41c241e is going to be created. [ 1157.082029] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.082229] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.082342] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.082627] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.082861] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.083108] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-eb19c26f-1014-46fe-931c-d0d0f41c241e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.188708] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.304700] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e010a3d8-12ba-4790-bd4e-82c0e5662a99 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.304912] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.304912] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.305162] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.305375] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.305485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.305554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.305711] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.305801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.305892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.306050] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e010a3d8-12ba-4790-bd4e-82c0e5662a99 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.306147] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.306204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.306345] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.306482] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.306572] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.306633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.306770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.306864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.306958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.307060] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e010a3d8-12ba-4790-bd4e-82c0e5662a99',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.398049] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: SUCCESS [ 1157.398417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.480671] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.480852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.480942] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.481259] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.481359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.481488] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 is going to be created. [ 1157.502476] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.502677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.502677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.502928] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.503110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.512157] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 in Status: UNINITIALIZED for 2s [ 1157.699328] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.699328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.699328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.699328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.699328] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.699328] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 is going to be updated. [ 1157.725820] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.728288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.728288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.728288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.728288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.740318] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: IN_PROGRESS for 2s [ 1157.809627] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e010a3d8-12ba-4790-bd4e-82c0e5662a99: rpc.has_security_group_logging(os_id): False [ 1157.827548] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.827629] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.827709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.827995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.828202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.828551] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.828740] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.828822] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.829034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.829134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.829477] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.829631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.829699] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.829857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.829961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.830217] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.830321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.830437] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.830703] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.830803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.830896] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 is going to be created. [ 1157.887525] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.887728] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.887803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.888039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.888683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.901047] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 in Status: IN_PROGRESS for 2s [ 1158.061051] env[71140]: INFO networking_nsxv3.common.synchronization [req-1adda4cc-55c6-4701-9297-ba98035eccff req-d0cefafb-ff56-44bb-8075-033329d47b37 service nova] Enqueued Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_rules [ 1158.061307] env[71140]: INFO networking_nsxv3.common.synchronization [req-1adda4cc-55c6-4701-9297-ba98035eccff req-d0cefafb-ff56-44bb-8075-033329d47b37 service nova] Enqueued Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_members [ 1158.061491] env[71140]: INFO networking_nsxv3.common.synchronization [req-1adda4cc-55c6-4701-9297-ba98035eccff req-d0cefafb-ff56-44bb-8075-033329d47b37 service nova] Enqueued Resource ID: eb19c26f-1014-46fe-931c-d0d0f41c241e with Priority: HIGHEST for action port [ 1158.062171] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_rules [ 1158.062358] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_members [ 1158.062546] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb19c26f-1014-46fe-931c-d0d0f41c241e with Priority: HIGHEST for action port [ 1158.062937] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.063740] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.063985] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.064203] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.064334] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.069018] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.069018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.069018] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb19c26f-1014-46fe-931c-d0d0f41c241e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.069018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb19c26f-1014-46fe-931c-d0d0f41c241e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.069018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb19c26f-1014-46fe-931c-d0d0f41c241e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.069018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb19c26f-1014-46fe-931c-d0d0f41c241e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.069018] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb19c26f-1014-46fe-931c-d0d0f41c241e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.566308] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.566437] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.569106] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb19c26f-1014-46fe-931c-d0d0f41c241e with status ACTIVE [ 1158.569106] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.569214] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.569214] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.569473] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.569577] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.569784] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.569913] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.569982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.570241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.570316] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.570498] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.570610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.570672] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.570813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.570886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.570972] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb19c26f-1014-46fe-931c-d0d0f41c241e is going to be updated. [ 1158.591201] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.591350] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.591420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.591597] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.591728] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.591875] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb19c26f-1014-46fe-931c-d0d0f41c241e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.522144] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 in Status: SUCCESS [ 1159.522453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.522810] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.523079] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.523284] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.523411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.523484] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.523678] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.523770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.523857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.523989] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fe121ab-f6de-4059-bbdf-9b957346a3d3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.749518] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: SUCCESS [ 1159.749727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.749905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.750202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.750404] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.750526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.750593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.750776] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.750923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.750923] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.911030] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 in Status: SUCCESS [ 1159.911287] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.026374] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fe121ab-f6de-4059-bbdf-9b957346a3d3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.254528] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.528279] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fe121ab-f6de-4059-bbdf-9b957346a3d3: rpc.has_security_group_logging(os_id): False [ 1160.545313] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.545472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.545545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.545779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.545872] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.546140] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.546282] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.546353] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.546576] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.546607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.546700] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 is going to be created. [ 1160.608174] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.608174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.608174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.608174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.608174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.622431] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 in Status: IN_PROGRESS for 2s [ 1160.756455] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.815622] env[71140]: INFO networking_nsxv3.common.synchronization [req-a6766821-c2cd-4db3-875e-9fd45792a57b req-f2c0edeb-c986-45be-8bdf-008fcb4ff847 tempest-ServersTestJSON-1092316267 tempest-ServersTestJSON-1092316267-project-member] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1160.816138] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1160.816451] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.816573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.816639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.816844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.816994] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.817112] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.817172] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.817320] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.817399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.817511] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.249374] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-452 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.249581] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.249712] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.249982] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.251352] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.251531] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.251660] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.251888] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.252054] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.252276] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.252396] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1161.252535] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1161.252652] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1161.252768] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.252878] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1161.253026] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1161.260210] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.260336] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.260454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.260632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.260719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.260812] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 is going to be updated. [ 1161.276018] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1161.276344] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1161.276408] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1161.276529] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.276824] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-3db0bcb7-c407-4d91-8f68-30954c58c753 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.276988] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-3db0bcb7-c407-4d91-8f68-30954c58c753" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.277117] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-3db0bcb7-c407-4d91-8f68-30954c58c753" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.277470] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-3db0bcb7-c407-4d91-8f68-30954c58c753" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.277611] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3db0bcb7-c407-4d91-8f68-30954c58c753',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.290836] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.291030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.291030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.291229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.291362] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.303350] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: IN_PROGRESS for 2s [ 1161.319464] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.780387] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.780764] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.780764] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.781054] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.781235] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.781395] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 3db0bcb7-c407-4d91-8f68-30954c58c753 not found, creating... [ 1161.781659] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.781819] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.781940] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.782187] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.782331] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.782610] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.782769] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.782888] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.783251] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.783251] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.783474] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 3db0bcb7-c407-4d91-8f68-30954c58c753 is going to be created. [ 1161.803867] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.804111] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.804374] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.804583] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.805163] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.805163] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-3db0bcb7-c407-4d91-8f68-30954c58c753" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.823927] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.327394] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.327598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.327674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.327905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.327997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.328116] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1162.359638] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.359837] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.359902] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.360193] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.360370] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.368984] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1162.614331] env[71140]: INFO networking_nsxv3.common.synchronization [req-a6766821-c2cd-4db3-875e-9fd45792a57b req-b2484dd7-a236-44e9-b55e-a35b3f031b4b service nova] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_rules [ 1162.614598] env[71140]: INFO networking_nsxv3.common.synchronization [req-a6766821-c2cd-4db3-875e-9fd45792a57b req-b2484dd7-a236-44e9-b55e-a35b3f031b4b service nova] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1162.614876] env[71140]: INFO networking_nsxv3.common.synchronization [req-a6766821-c2cd-4db3-875e-9fd45792a57b req-b2484dd7-a236-44e9-b55e-a35b3f031b4b service nova] Enqueued Resource ID: 3db0bcb7-c407-4d91-8f68-30954c58c753 with Priority: HIGHEST for action port [ 1162.615523] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_rules [ 1162.615685] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1162.615799] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3db0bcb7-c407-4d91-8f68-30954c58c753 with Priority: HIGHEST for action port [ 1162.616165] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.616362] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.616451] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.616685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.617291] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.621342] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.621342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.621342] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-3db0bcb7-c407-4d91-8f68-30954c58c753 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.621342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3db0bcb7-c407-4d91-8f68-30954c58c753" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.621342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3db0bcb7-c407-4d91-8f68-30954c58c753" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.621342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3db0bcb7-c407-4d91-8f68-30954c58c753" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.621342] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3db0bcb7-c407-4d91-8f68-30954c58c753',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.632786] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 in Status: SUCCESS [ 1162.633100] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.121079] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.121707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.124158] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3db0bcb7-c407-4d91-8f68-30954c58c753 with status ACTIVE [ 1163.126255] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.126403] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.126485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.126727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.126841] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.127054] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.127163] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.127223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.127390] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.127471] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.127665] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.127764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.127824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.127980] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.128089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.128225] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3db0bcb7-c407-4d91-8f68-30954c58c753 is going to be updated. [ 1163.150592] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.150736] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.150859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.151122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.151344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.151485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3db0bcb7-c407-4d91-8f68-30954c58c753" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.156173] env[71140]: INFO networking_nsxv3.common.synchronization [req-81a2e733-5b35-4903-9d8f-531b4a1eaa72 req-594590a2-7600-4776-a7b4-74d22654d1c1 tempest-ServersNegativeTestMultiTenantJSON-1394103094 tempest-ServersNegativeTestMultiTenantJSON-1394103094-project-member] Enqueued Resource ID: a482dc33-1078-4fb7-8fcb-21990f415f82 with Priority: HIGHEST for action security_group_members [ 1163.156709] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a482dc33-1078-4fb7-8fcb-21990f415f82 with Priority: HIGHEST for action security_group_members [ 1163.156932] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a482dc33-1078-4fb7-8fcb-21990f415f82 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.157081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.157151] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.157412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.157618] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.157743] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.157809] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.157966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.158175] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.158296] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a482dc33-1078-4fb7-8fcb-21990f415f82',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.313327] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: SUCCESS [ 1163.313588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.313750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.313957] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.314161] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.314279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.314345] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.314494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.314576] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.314663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.314753] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.509103] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-546 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.510325] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-546" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.510325] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-546" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.510325] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-546" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.510325] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.510539] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.510539] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.510837] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.510996] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.511254] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1163.511440] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1163.511636] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1163.512129] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1163.512129] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1163.512129] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1163.512327] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1163.531653] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1163.531838] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1163.531980] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1163.532184] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-546" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.532564] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-e96274fa-78d2-4476-abc6-e68c580fb3fe taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.532778] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-e96274fa-78d2-4476-abc6-e68c580fb3fe" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.532919] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-e96274fa-78d2-4476-abc6-e68c580fb3fe" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.533264] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-e96274fa-78d2-4476-abc6-e68c580fb3fe" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.533411] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e96274fa-78d2-4476-abc6-e68c580fb3fe',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.661555] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.661749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.661832] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.662100] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.662200] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.662464] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.662570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.662727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.663180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.663288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.663399] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a482dc33-1078-4fb7-8fcb-21990f415f82 already deleted. [ 1163.663486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.818089] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.818089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.818089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.818089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.818366] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.818416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.818723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.818723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.818723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.818859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.818950] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.819104] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.819104] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.819249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.819384] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.819474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.819529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.819665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.819788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.819833] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.819903] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.036125] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.036125] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.036125] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.036125] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.036304] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.036304] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port e96274fa-78d2-4476-abc6-e68c580fb3fe not found, creating... [ 1164.036587] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.036773] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.036896] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.037400] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.037400] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.037601] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.037770] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.037918] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.038196] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.038355] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.038511] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: e96274fa-78d2-4476-abc6-e68c580fb3fe is going to be created. [ 1164.057694] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.057933] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.058130] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.058498] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.058767] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.059065] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-e96274fa-78d2-4476-abc6-e68c580fb3fe" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.321795] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8bf2e04-ddcc-43f4-b665-59a628a61547: rpc.has_security_group_logging(os_id): False [ 1164.339958] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.340128] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.340265] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.340520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.340638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.341071] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.341071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.341071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.341249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.341286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.341499] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.343660] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.343790] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.343943] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.344036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.344231] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.344327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.344389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.344529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.344602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.344689] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 is going to be updated. [ 1164.376695] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1164.376987] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.377168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.377388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.377691] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.377691] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.377779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.377890] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.378028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.378064] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.400773] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.400998] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.401109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.401426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.401607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.414026] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: IN_PROGRESS for 2s [ 1164.881216] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.919290] env[71140]: INFO networking_nsxv3.common.synchronization [req-81a2e733-5b35-4903-9d8f-531b4a1eaa72 req-f2e3cace-c342-47c8-bcbe-ff83a4f7893b service nova] Enqueued Resource ID: a482dc33-1078-4fb7-8fcb-21990f415f82 with Priority: HIGHEST for action security_group_rules [ 1164.919438] env[71140]: INFO networking_nsxv3.common.synchronization [req-81a2e733-5b35-4903-9d8f-531b4a1eaa72 req-f2e3cace-c342-47c8-bcbe-ff83a4f7893b service nova] Enqueued Resource ID: a482dc33-1078-4fb7-8fcb-21990f415f82 with Priority: HIGHEST for action security_group_members [ 1164.919586] env[71140]: INFO networking_nsxv3.common.synchronization [req-81a2e733-5b35-4903-9d8f-531b4a1eaa72 req-f2e3cace-c342-47c8-bcbe-ff83a4f7893b service nova] Enqueued Resource ID: e96274fa-78d2-4476-abc6-e68c580fb3fe with Priority: HIGHEST for action port [ 1164.920045] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a482dc33-1078-4fb7-8fcb-21990f415f82 with Priority: HIGHEST for action security_group_rules [ 1164.920185] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a482dc33-1078-4fb7-8fcb-21990f415f82 with Priority: HIGHEST for action security_group_members [ 1164.920359] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e96274fa-78d2-4476-abc6-e68c580fb3fe with Priority: HIGHEST for action port [ 1164.921283] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a482dc33-1078-4fb7-8fcb-21990f415f82 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.921283] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.921283] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.921283] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.921487] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a482dc33-1078-4fb7-8fcb-21990f415f82',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.922237] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a482dc33-1078-4fb7-8fcb-21990f415f82 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.922362] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.922419] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.922596] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.922744] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.922856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.922923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.923053] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.923141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.923225] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a482dc33-1078-4fb7-8fcb-21990f415f82',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.924016] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-e96274fa-78d2-4476-abc6-e68c580fb3fe taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.924144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e96274fa-78d2-4476-abc6-e68c580fb3fe" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.924196] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e96274fa-78d2-4476-abc6-e68c580fb3fe" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.924567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e96274fa-78d2-4476-abc6-e68c580fb3fe" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.924567] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e96274fa-78d2-4476-abc6-e68c580fb3fe',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.384964] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.425905] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a482dc33-1078-4fb7-8fcb-21990f415f82',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.426881] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a482dc33-1078-4fb7-8fcb-21990f415f82 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.426995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.427323] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e96274fa-78d2-4476-abc6-e68c580fb3fe with status ACTIVE [ 1165.427484] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.429383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.429383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.429383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.429383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.429383] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.429383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.429383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.429383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.429383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.429383] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.429383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.434136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.434362] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.434451] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.434551] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e96274fa-78d2-4476-abc6-e68c580fb3fe is going to be updated. [ 1165.460021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.460021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.460021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.460021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.460021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.460021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e96274fa-78d2-4476-abc6-e68c580fb3fe" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.891607] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.891803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.891875] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.892137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.892250] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.892366] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1165.919812] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.920037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.920093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.920400] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.920633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.927843] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a482dc33-1078-4fb7-8fcb-21990f415f82',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.929317] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1166.125230] env[71140]: INFO networking_nsxv3.common.synchronization [req-c8db1e7d-f747-4698-8cd1-9ca4466b17dd req-420a3100-ca60-4925-95d2-cd066d5fc962 tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_members [ 1166.125814] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_members [ 1166.126139] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-83375852-3b13-42bc-b95c-09c5949dc69a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.126265] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.126335] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.126546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.126707] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.126810] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.126873] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.127032] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.127150] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.127201] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.429645] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: SUCCESS [ 1166.429991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.430287] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.430413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.430507] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.430690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.430773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.431685] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a482dc33-1078-4fb7-8fcb-21990f415f82 is going to be created. [ 1166.453511] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.453718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.453718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.453927] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.454111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.462591] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a482dc33-1078-4fb7-8fcb-21990f415f82 in Status: UNINITIALIZED for 2s [ 1166.504073] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-941 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.504293] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.504423] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.504693] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.504958] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.505133] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.505468] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.505711] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.505864] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.506099] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1166.506220] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1166.506338] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1166.506451] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1166.507013] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1166.507240] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1166.507401] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1166.526473] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1166.526655] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1166.526800] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1166.526981] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.527337] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-ee9d8032-0a6b-4ea4-a60c-12a0cc945dff taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.527518] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-ee9d8032-0a6b-4ea4-a60c-12a0cc945dff" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.527652] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-ee9d8032-0a6b-4ea4-a60c-12a0cc945dff" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.528104] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-ee9d8032-0a6b-4ea4-a60c-12a0cc945dff" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.528318] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee9d8032-0a6b-4ea4-a60c-12a0cc945dff',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.628984] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.016030] env[71140]: INFO networking_nsxv3.common.synchronization [req-16911b0a-9393-40e4-a088-121742cdfbd1 req-b7cbb3e3-0671-4df6-aacf-32656cded15e tempest-AttachVolumeTestJSON-775620922 tempest-AttachVolumeTestJSON-775620922-project-member] Enqueued Resource ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 with Priority: HIGHEST for action security_group_members [ 1167.016030] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 with Priority: HIGHEST for action security_group_members [ 1167.016728] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9372f7d-fcc5-4703-b77d-bbb4d1695328 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.017057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.017286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.019351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.019351] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.019351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.019351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.019351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.019351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.019351] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9372f7d-fcc5-4703-b77d-bbb4d1695328',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.034020] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.034020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.034020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.034020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.034020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.034020] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port ee9d8032-0a6b-4ea4-a60c-12a0cc945dff not found, creating... [ 1167.034020] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.034020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.034020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.034020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.034572] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.035240] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.035699] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.036113] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.036631] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.039019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.039019] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: ee9d8032-0a6b-4ea4-a60c-12a0cc945dff is going to be created. [ 1167.061120] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.061120] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.061120] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.061369] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.062032] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.062032] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-ee9d8032-0a6b-4ea4-a60c-12a0cc945dff" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.131408] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.446637] env[71140]: INFO networking_nsxv3.common.synchronization [req-189a64db-aceb-48b9-bf44-67709daab93a req-901cbcb7-30f8-4ce8-93f0-7ecaaed58a37 tempest-ServerRescueTestJSONUnderV235-49877120 tempest-ServerRescueTestJSONUnderV235-49877120-project-member] Enqueued Resource ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca with Priority: HIGHEST for action security_group_members [ 1167.446970] env[71140]: INFO networking_nsxv3.common.synchronization [req-189a64db-aceb-48b9-bf44-67709daab93a req-901cbcb7-30f8-4ce8-93f0-7ecaaed58a37 tempest-ServerRescueTestJSONUnderV235-49877120 tempest-ServerRescueTestJSONUnderV235-49877120-project-member] Enqueued Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_members [ 1167.450092] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca with Priority: HIGHEST for action security_group_members [ 1167.450092] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_members [ 1167.451239] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8c0913e-edda-4b9e-9b95-37c7730e10ca taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.451239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.451239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.451239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.451957] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.452883] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.453769] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.454092] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.454198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.454378] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8c0913e-edda-4b9e-9b95-37c7730e10ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.455606] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ddcb2b-491d-450f-80bc-7c6250b005e1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.455756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.455807] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.455981] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.456457] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.457677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.458601] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.458724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.458859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.458979] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.524174] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.524174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.524174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.524174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.524174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.524511] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.524511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.524664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.524722] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.524760] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.524837] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 is going to be updated. [ 1167.540935] env[71140]: INFO networking_nsxv3.common.synchronization [req-189a64db-aceb-48b9-bf44-67709daab93a req-901cbcb7-30f8-4ce8-93f0-7ecaaed58a37 tempest-ServerRescueTestJSONUnderV235-49877120 tempest-ServerRescueTestJSONUnderV235-49877120-project-member] Enqueued Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_rules [ 1167.541136] env[71140]: INFO networking_nsxv3.common.synchronization [req-189a64db-aceb-48b9-bf44-67709daab93a req-901cbcb7-30f8-4ce8-93f0-7ecaaed58a37 tempest-ServerRescueTestJSONUnderV235-49877120 tempest-ServerRescueTestJSONUnderV235-49877120-project-member] Enqueued Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_members [ 1167.541286] env[71140]: INFO networking_nsxv3.common.synchronization [req-189a64db-aceb-48b9-bf44-67709daab93a req-901cbcb7-30f8-4ce8-93f0-7ecaaed58a37 tempest-ServerRescueTestJSONUnderV235-49877120 tempest-ServerRescueTestJSONUnderV235-49877120-project-member] Enqueued Resource ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca with Priority: HIGHEST for action security_group_rules [ 1167.541449] env[71140]: INFO networking_nsxv3.common.synchronization [req-189a64db-aceb-48b9-bf44-67709daab93a req-901cbcb7-30f8-4ce8-93f0-7ecaaed58a37 tempest-ServerRescueTestJSONUnderV235-49877120 tempest-ServerRescueTestJSONUnderV235-49877120-project-member] Enqueued Resource ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca with Priority: HIGHEST for action security_group_members [ 1167.541596] env[71140]: INFO networking_nsxv3.common.synchronization [req-189a64db-aceb-48b9-bf44-67709daab93a req-901cbcb7-30f8-4ce8-93f0-7ecaaed58a37 tempest-ServerRescueTestJSONUnderV235-49877120 tempest-ServerRescueTestJSONUnderV235-49877120-project-member] Enqueued Resource ID: c676dba9-4f99-470a-86bf-42a06945b1b8 with Priority: HIGHEST for action port [ 1167.542153] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_rules [ 1167.542292] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca with Priority: HIGHEST for action security_group_rules [ 1167.542388] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c676dba9-4f99-470a-86bf-42a06945b1b8 with Priority: HIGHEST for action port [ 1167.542483] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_members [ 1167.542585] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca with Priority: HIGHEST for action security_group_members [ 1167.542847] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4ddcb2b-491d-450f-80bc-7c6250b005e1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.542963] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.543028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.544160] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.544160] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.544160] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8c0913e-edda-4b9e-9b95-37c7730e10ca taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.544327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.544365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.544574] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.544665] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8c0913e-edda-4b9e-9b95-37c7730e10ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.545468] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-c676dba9-4f99-470a-86bf-42a06945b1b8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.545583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c676dba9-4f99-470a-86bf-42a06945b1b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.545635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c676dba9-4f99-470a-86bf-42a06945b1b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.545788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c676dba9-4f99-470a-86bf-42a06945b1b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.545870] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c676dba9-4f99-470a-86bf-42a06945b1b8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.546606] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ddcb2b-491d-450f-80bc-7c6250b005e1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.546701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.548189] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8c0913e-edda-4b9e-9b95-37c7730e10ca taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.548189] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.552388] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.552939] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.552939] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.553057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.553167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.563036] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 in Status: IN_PROGRESS for 2s [ 1167.636475] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.636475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.636475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.636475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.636475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.636475] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83375852-3b13-42bc-b95c-09c5949dc69a is going to be updated. [ 1167.664442] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.664442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.664442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.664442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.664442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.672621] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83375852-3b13-42bc-b95c-09c5949dc69a in Status: IN_PROGRESS for 2s [ 1167.807041] env[71140]: INFO networking_nsxv3.common.synchronization [req-71723700-b102-408b-98ca-18c582c6b62a req-2af9e289-cdb7-4771-bc83-5d20ca85abe9 tempest-AttachInterfacesV270Test-171536725 tempest-AttachInterfacesV270Test-171536725-project-member] Enqueued Resource ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 with Priority: HIGHEST for action security_group_members [ 1167.810914] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 with Priority: HIGHEST for action security_group_members [ 1167.810914] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e010a3d8-12ba-4790-bd4e-82c0e5662a99 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.810914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.810914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.810914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.810914] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.810914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.810914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.810914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.810914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.810914] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e010a3d8-12ba-4790-bd4e-82c0e5662a99',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.941124] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1167.941124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.941124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.941124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.941124] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.941124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.941124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.941124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.941124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.941124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.941124] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.964926] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8c0913e-edda-4b9e-9b95-37c7730e10ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.967338] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.989376] env[71140]: INFO networking_nsxv3.common.synchronization [req-a782248a-16ac-4fe6-b8cf-7069519a9c84 req-769ba93c-81f8-40e2-8381-8243304428ee tempest-ServerRescueTestJSONUnderV235-49877120 tempest-ServerRescueTestJSONUnderV235-49877120-project-member] Enqueued Resource ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca with Priority: HIGHEST for action security_group_members [ 1167.989688] env[71140]: INFO networking_nsxv3.common.synchronization [req-a782248a-16ac-4fe6-b8cf-7069519a9c84 req-769ba93c-81f8-40e2-8381-8243304428ee tempest-ServerRescueTestJSONUnderV235-49877120 tempest-ServerRescueTestJSONUnderV235-49877120-project-member] Enqueued Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_members [ 1167.990975] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca with Priority: HIGHEST for action security_group_members [ 1167.991257] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_members [ 1167.993384] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8c0913e-edda-4b9e-9b95-37c7730e10ca taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.993559] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.993859] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ddcb2b-491d-450f-80bc-7c6250b005e1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.994212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.039494] env[71140]: INFO networking_nsxv3.common.synchronization [req-a782248a-16ac-4fe6-b8cf-7069519a9c84 req-769ba93c-81f8-40e2-8381-8243304428ee tempest-ServerRescueTestJSONUnderV235-49877120 tempest-ServerRescueTestJSONUnderV235-49877120-project-member] Enqueued Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_rules [ 1168.039674] env[71140]: INFO networking_nsxv3.common.synchronization [req-a782248a-16ac-4fe6-b8cf-7069519a9c84 req-769ba93c-81f8-40e2-8381-8243304428ee tempest-ServerRescueTestJSONUnderV235-49877120 tempest-ServerRescueTestJSONUnderV235-49877120-project-member] Enqueued Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_members [ 1168.039754] env[71140]: INFO networking_nsxv3.common.synchronization [req-a782248a-16ac-4fe6-b8cf-7069519a9c84 req-769ba93c-81f8-40e2-8381-8243304428ee tempest-ServerRescueTestJSONUnderV235-49877120 tempest-ServerRescueTestJSONUnderV235-49877120-project-member] Enqueued Resource ID: c676dba9-4f99-470a-86bf-42a06945b1b8 with Priority: HIGHEST for action port [ 1168.040446] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_rules [ 1168.040491] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_members [ 1168.040676] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c676dba9-4f99-470a-86bf-42a06945b1b8 with Priority: HIGHEST for action port [ 1168.040860] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4ddcb2b-491d-450f-80bc-7c6250b005e1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.040957] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.041176] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ddcb2b-491d-450f-80bc-7c6250b005e1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.041263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.041455] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-c676dba9-4f99-470a-86bf-42a06945b1b8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.041548] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c676dba9-4f99-470a-86bf-42a06945b1b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.047679] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ddcb2b-491d-450f-80bc-7c6250b005e1 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.047793] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.049215] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8c0913e-edda-4b9e-9b95-37c7730e10ca taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.049354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.049564] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c676dba9-4f99-470a-86bf-42a06945b1b8 with status ACTIVE [ 1168.049720] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.049837] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.049898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.050148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.050236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.050491] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.050583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.050641] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.050800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.050941] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.052150] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.052150] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.052150] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.052150] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.052150] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.052150] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c676dba9-4f99-470a-86bf-42a06945b1b8 is going to be updated. [ 1168.071067] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.071273] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.071326] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.071560] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.071712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.071882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c676dba9-4f99-470a-86bf-42a06945b1b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.072068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c676dba9-4f99-470a-86bf-42a06945b1b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.072249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c676dba9-4f99-470a-86bf-42a06945b1b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.072350] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c676dba9-4f99-470a-86bf-42a06945b1b8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.181023] env[71140]: INFO networking_nsxv3.common.synchronization [req-c8db1e7d-f747-4698-8cd1-9ca4466b17dd req-5d31b118-3adc-4be7-ac23-5c59c74d678a service nova] Enqueued Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_rules [ 1168.181023] env[71140]: INFO networking_nsxv3.common.synchronization [req-c8db1e7d-f747-4698-8cd1-9ca4466b17dd req-5d31b118-3adc-4be7-ac23-5c59c74d678a service nova] Enqueued Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_members [ 1168.181023] env[71140]: INFO networking_nsxv3.common.synchronization [req-c8db1e7d-f747-4698-8cd1-9ca4466b17dd req-5d31b118-3adc-4be7-ac23-5c59c74d678a service nova] Enqueued Resource ID: ee9d8032-0a6b-4ea4-a60c-12a0cc945dff with Priority: HIGHEST for action port [ 1168.181023] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_rules [ 1168.181023] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_members [ 1168.181023] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee9d8032-0a6b-4ea4-a60c-12a0cc945dff with Priority: HIGHEST for action port [ 1168.181023] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83375852-3b13-42bc-b95c-09c5949dc69a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.181023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.185532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.185532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.185532] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.185532] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-83375852-3b13-42bc-b95c-09c5949dc69a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.185532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.185532] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee9d8032-0a6b-4ea4-a60c-12a0cc945dff taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.185532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee9d8032-0a6b-4ea4-a60c-12a0cc945dff" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.185532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee9d8032-0a6b-4ea4-a60c-12a0cc945dff" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.185532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee9d8032-0a6b-4ea4-a60c-12a0cc945dff" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.185532] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee9d8032-0a6b-4ea4-a60c-12a0cc945dff',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.313948] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.314722] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.315019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.315167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.315342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.315612] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.315776] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.315910] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.316165] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.316344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.316487] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 is going to be updated. [ 1168.342726] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.342926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.342926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.343325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.343509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.351319] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 in Status: IN_PROGRESS for 2s [ 1168.442280] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.442280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.442558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.442558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.442702] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.442796] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.442869] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.443033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.443129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.443227] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.443747] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.443747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.443747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.443747] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.443971] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.443971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.443971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.444147] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.444147] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.444234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.444279] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.468068] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8c0913e-edda-4b9e-9b95-37c7730e10ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.471600] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a482dc33-1078-4fb7-8fcb-21990f415f82 in Status: SUCCESS [ 1168.471835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.472076] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.472792] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.473083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.473253] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.473377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.473442] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.473602] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.473686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.473772] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.473857] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a482dc33-1078-4fb7-8fcb-21990f415f82',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.575455] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c676dba9-4f99-470a-86bf-42a06945b1b8 with status ACTIVE [ 1168.575696] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.575837] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.575900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.576153] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.576250] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.576423] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.576535] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.576594] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.576744] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.576819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.576995] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.577102] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.577164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.577296] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.577369] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.577468] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c676dba9-4f99-470a-86bf-42a06945b1b8 is going to be updated. [ 1168.596253] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.596423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.596463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.596659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.596826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.596998] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c676dba9-4f99-470a-86bf-42a06945b1b8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.686687] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-83375852-3b13-42bc-b95c-09c5949dc69a taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.687161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.688109] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee9d8032-0a6b-4ea4-a60c-12a0cc945dff with status ACTIVE [ 1168.688109] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.688109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.688392] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.688583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.689309] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.689309] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.689309] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.689309] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.689515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.689613] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.689945] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.690139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.690216] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.690454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.690570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.690668] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee9d8032-0a6b-4ea4-a60c-12a0cc945dff is going to be updated. [ 1168.713908] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.714256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.714256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.714486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.714655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.714875] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee9d8032-0a6b-4ea4-a60c-12a0cc945dff" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.947559] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e8717ad-052a-4a86-b223-df55dd81c619: rpc.has_security_group_logging(os_id): False [ 1168.966027] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.966027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.966027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.966027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.966027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.966027] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.966027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.966027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.966027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.966027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.966027] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.966027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.966027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.966624] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.966945] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.967363] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.967677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.967885] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.968317] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.968541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.968799] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1168.975968] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.979021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.979021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.979021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.979021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.979021] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 is going to be updated. [ 1168.979021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.979021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.979021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.979021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.979021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.979021] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca is going to be created. [ 1168.980579] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a482dc33-1078-4fb7-8fcb-21990f415f82 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.984164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.984164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.984164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.984164] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.984164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.984164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.984164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.984164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.984164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.984164] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a482dc33-1078-4fb7-8fcb-21990f415f82 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.984164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.984164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.984164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.984164] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.984164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.984164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.984164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.984656] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.984656] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.984656] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a482dc33-1078-4fb7-8fcb-21990f415f82',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.012258] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.012449] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.012723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.013080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.013467] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.019313] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.019313] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.019313] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.019528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.019528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.022378] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca in Status: UNINITIALIZED for 2s [ 1169.025893] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 in Status: IN_PROGRESS for 2s [ 1169.042525] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.042781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.042869] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.043112] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.043268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.058945] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1169.488054] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a482dc33-1078-4fb7-8fcb-21990f415f82: rpc.has_security_group_logging(os_id): False [ 1169.505867] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.505949] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.506111] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.506281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.506372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.506592] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.506689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.506750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.506905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.506977] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.507440] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.507440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.507440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.507440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.507666] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.507703] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.508391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.508391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.508391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.508605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.508761] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a482dc33-1078-4fb7-8fcb-21990f415f82 is going to be created. [ 1169.567258] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.567404] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.567476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.567686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.567866] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.574484] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 in Status: SUCCESS [ 1169.574676] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 deletion is rescheduled due to dependency. [ 1169.574787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.579765] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a482dc33-1078-4fb7-8fcb-21990f415f82 in Status: IN_PROGRESS for 2s [ 1169.686428] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83375852-3b13-42bc-b95c-09c5949dc69a in Status: SUCCESS [ 1169.686428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.686428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.686635] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.690028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.690028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.690028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.690028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.690028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.690028] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.193025] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.365138] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 in Status: SUCCESS [ 1170.366088] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e010a3d8-12ba-4790-bd4e-82c0e5662a99 deletion is rescheduled due to dependency. [ 1170.366088] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e010a3d8-12ba-4790-bd4e-82c0e5662a99" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.678578] env[71140]: INFO networking_nsxv3.common.synchronization [req-b8050947-85a3-466a-9350-a0e88d5e3f24 req-a5418e81-13d9-465c-8e11-d3f5d574ca2b tempest-ServersNegativeTestJSON-651441888 tempest-ServersNegativeTestJSON-651441888-project-member] Enqueued Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_members [ 1170.679419] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_members [ 1170.679876] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.680075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.680198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.680499] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.680730] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.680906] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.681020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.681282] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.681424] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.681579] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.692175] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.033273] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca in Status: SUCCESS [ 1171.033431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.033487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.033663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.033852] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.033969] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.034046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.034201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.034286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.034375] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8c0913e-edda-4b9e-9b95-37c7730e10ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.035764] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 in Status: SUCCESS [ 1171.035972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.036094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.036260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.036418] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.036521] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.036586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.036723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.036811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.036899] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.069974] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1171.069974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.184533] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.194549] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.194715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.194762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.194991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.195110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.195228] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83375852-3b13-42bc-b95c-09c5949dc69a is going to be updated. [ 1171.222274] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.222758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.222758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.222758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.223009] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.230843] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83375852-3b13-42bc-b95c-09c5949dc69a in Status: IN_PROGRESS for 2s [ 1171.539074] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.539581] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.539926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.540283] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.540552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.540917] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.544874] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.544944] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.545155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.545250] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.545356] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca is going to be deleted. [ 1171.546399] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.570724] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.570978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.570978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.571235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.571345] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.571508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.571676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.571848] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.572039] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.572137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.572240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.572395] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.572433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.572502] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8c0913e-edda-4b9e-9b95-37c7730e10ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.590933] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a482dc33-1078-4fb7-8fcb-21990f415f82 in Status: SUCCESS [ 1171.590933] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.688028] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.049749] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.075094] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.075341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.075341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.075558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.075651] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.075936] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.076058] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.076153] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.076318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.076404] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.076569] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca already deleted. [ 1172.076671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.077228] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.077476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.077653] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.077757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.077820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.077963] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.078052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.078146] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8c0913e-edda-4b9e-9b95-37c7730e10ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.190178] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.190411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.190499] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.190724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.190824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.190918] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 is going to be updated. [ 1172.222519] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.222519] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.222519] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.222697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.222800] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.242178] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: IN_PROGRESS for 2s [ 1172.552839] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.553016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.553180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.553395] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.553815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.553815] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 is going to be updated. [ 1172.579045] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.579258] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.579337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.579610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.579697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.580897] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.581009] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.581528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.581737] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.581854] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.582097] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.582238] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.582335] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.582762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.582762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.582762] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca already deleted. [ 1172.582762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.582931] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8c0913e-edda-4b9e-9b95-37c7730e10ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.592243] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 in Status: IN_PROGRESS for 2s [ 1173.086570] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8c0913e-edda-4b9e-9b95-37c7730e10ca',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.244298] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83375852-3b13-42bc-b95c-09c5949dc69a in Status: SUCCESS [ 1173.244558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.244741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.244977] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.245218] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.245353] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.245741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.245741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.245741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.245741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.245919] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.450046] env[71140]: INFO networking_nsxv3.common.synchronization [None req-77a9e3f3-c1ff-41b2-8d52-c7e2c6405bff tempest-AttachVolumeTestJSON-775620922 tempest-AttachVolumeTestJSON-775620922-project-member] Enqueued Resource ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b with Priority: HIGHEST for action security_group_rules [ 1173.451126] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b with Priority: HIGHEST for action security_group_rules [ 1173.451615] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.451858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.451936] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.452320] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.452514] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42f38ff1-7afd-4b06-8a81-a4f009035e8b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.564622] env[71140]: INFO networking_nsxv3.common.synchronization [None req-55b6afd9-36f3-4aa8-bd04-307a227ed159 tempest-AttachVolumeTestJSON-775620922 tempest-AttachVolumeTestJSON-775620922-project-member] Enqueued Resource ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b with Priority: HIGHEST for action security_group_rules [ 1173.565183] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b with Priority: HIGHEST for action security_group_rules [ 1173.565811] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.566491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.589451] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8c0913e-edda-4b9e-9b95-37c7730e10ca: rpc.has_security_group_logging(os_id): False [ 1173.606673] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.606875] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.606875] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.607118] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.607216] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.607403] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.607495] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.607559] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.607709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.608086] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.608086] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca is going to be created. [ 1173.624391] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/f8c0913e-edda-4b9e-9b95-37c7730e10ca], does not exist path=[/infra/domains/default/groups/f8c0913e-edda-4b9e-9b95-37c7730e10ca]."\n}' [ 1173.624550] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f8c0913e-edda-4b9e-9b95-37c7730e10ca [ 1173.624627] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1173.658419] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.658419] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.658419] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.659075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.660208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.660845] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.661780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.661780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.661780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.661780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.662046] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.662046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.662046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.662354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.662354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.662354] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8c0913e-edda-4b9e-9b95-37c7730e10ca is going to be created. [ 1173.678723] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/f8c0913e-edda-4b9e-9b95-37c7730e10ca], does not exist path=[/infra/domains/default/groups/f8c0913e-edda-4b9e-9b95-37c7730e10ca]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f8c0913e-edda-4b9e-9b95-37c7730e10ca [ 1173.679479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8c0913e-edda-4b9e-9b95-37c7730e10ca" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.679479] env[71140]: Traceback (most recent call last): [ 1173.679479] env[71140]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1173.679479] env[71140]: return func(*args, **kwargs) [ 1173.679479] env[71140]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1173.679479] env[71140]: res.raise_for_status() [ 1173.679479] env[71140]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1173.679479] env[71140]: raise HTTPError(http_error_msg, response=self) [ 1173.679479] env[71140]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f8c0913e-edda-4b9e-9b95-37c7730e10ca [ 1173.679479] env[71140]: During handling of the above exception, another exception occurred: [ 1173.679479] env[71140]: Traceback (most recent call last): [ 1173.679479] env[71140]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1173.679479] env[71140]: listener.cb(fileno) [ 1173.679479] env[71140]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1173.679479] env[71140]: result = function(*args, **kwargs) [ 1173.679479] env[71140]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1173.679479] env[71140]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1173.679479] env[71140]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1173.679479] env[71140]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1173.679479] env[71140]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1173.679479] env[71140]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1173.679479] env[71140]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1173.679479] env[71140]: res.raise_for_status() [ 1173.679479] env[71140]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1173.679479] env[71140]: raise HTTPError(http_error_msg, response=self) [ 1173.679479] env[71140]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f8c0913e-edda-4b9e-9b95-37c7730e10ca [ 1173.679479] env[71140]: Removing descriptor: 67 [ 1173.748289] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.970862] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.971033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.971457] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.971738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.971842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.971946] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b already deleted. [ 1173.972045] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.972209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.972380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.972586] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42f38ff1-7afd-4b06-8a81-a4f009035e8b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.010932] env[71140]: INFO networking_nsxv3.common.synchronization [req-d5ba9551-7a17-425e-912f-c87e8af36bcc req-2b8b0374-213c-4aaf-b72f-9bf206c5fdeb tempest-ServerRescueTestJSONUnderV235-49877120 tempest-ServerRescueTestJSONUnderV235-49877120-project-member] Enqueued Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_members [ 1174.011836] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 with Priority: HIGHEST for action security_group_members [ 1174.011836] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ddcb2b-491d-450f-80bc-7c6250b005e1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.011980] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.252631] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: SUCCESS [ 1174.253017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.253216] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83375852-3b13-42bc-b95c-09c5949dc69a: rpc.has_security_group_logging(os_id): False [ 1174.270974] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.271165] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.271270] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.271851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.291255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.291586] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.291732] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.291777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.291971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.292078] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.292256] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83375852-3b13-42bc-b95c-09c5949dc69a is going to be updated. [ 1174.360474] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.360696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.360696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.360918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.361081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.372455] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83375852-3b13-42bc-b95c-09c5949dc69a in Status: IN_PROGRESS for 2s [ 1174.499924] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.500095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.500167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.500444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.500592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.500795] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b already deleted. [ 1174.500902] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.601898] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 in Status: SUCCESS [ 1174.606165] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.606421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.606670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.606882] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.607019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.607129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.607255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.607341] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.607440] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.109837] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.110116] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.110280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.110976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.131389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.132124] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.132124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.132124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.132422] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.132422] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.132422] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 is going to be updated. [ 1175.160769] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.160932] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.160973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.161220] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.161369] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.168810] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 in Status: IN_PROGRESS for 2s [ 1176.412146] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83375852-3b13-42bc-b95c-09c5949dc69a in Status: SUCCESS [ 1176.412481] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.180758] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 in Status: SUCCESS [ 1177.180758] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 deletion is rescheduled due to dependency. [ 1177.180758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.180758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.180758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.180758] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.180758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.180758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.180758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.180758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.180758] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.311460] env[71140]: INFO networking_nsxv3.common.synchronization [None req-8893b387-d526-45e8-b680-2f7d54073b68 tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1177.311460] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1177.311862] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.312017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.312105] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.312324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.312685] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.312819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.312887] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.313069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.313161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.313256] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.683486] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.683486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.683486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.683486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.683486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.683486] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.683960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.683960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.683960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.683960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.683960] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 is going to be updated. [ 1177.706946] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.707119] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.707191] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.707392] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.707533] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.715860] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 in Status: IN_PROGRESS for 2s [ 1177.819368] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.819368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.819368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.819636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.842779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.843069] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.843248] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.843285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.843468] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.843550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.843638] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be updated. [ 1177.870321] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.870321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.870321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.870321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.870321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.876306] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: IN_PROGRESS for 2s [ 1178.745097] env[71140]: INFO networking_nsxv3.common.synchronization [req-fd834e96-ec8a-45c1-94cd-c9d8e8656183 req-802dd5db-2fc9-42b7-b893-2ec000bc19f9 tempest-ServersNegativeTestMultiTenantJSON-1394103094 tempest-ServersNegativeTestMultiTenantJSON-1394103094-project-member] Enqueued Resource ID: a482dc33-1078-4fb7-8fcb-21990f415f82 with Priority: HIGHEST for action security_group_members [ 1178.746276] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a482dc33-1078-4fb7-8fcb-21990f415f82 with Priority: HIGHEST for action security_group_members [ 1178.746276] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a482dc33-1078-4fb7-8fcb-21990f415f82 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.746386] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.746448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.746734] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.746811] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.746873] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.746971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.747091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.747176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.747270] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a482dc33-1078-4fb7-8fcb-21990f415f82',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.186467] env[71140]: INFO networking_nsxv3.common.synchronization [req-737d821b-ce93-4719-b99d-913f8d29300f req-eac64195-dfff-44e4-a53c-76211acd6984 tempest-ServersTestJSON-1092316267 tempest-ServersTestJSON-1092316267-project-member] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1179.187146] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1179.190923] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.190923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.190923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.190923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.191254] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.191254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.191254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.191390] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.191433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.191534] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.249593] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.249763] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.249836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.250068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.270577] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.270848] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.271083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.271159] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.271351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.271458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.271556] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a482dc33-1078-4fb7-8fcb-21990f415f82 is going to be updated. [ 1179.297226] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.297420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.297492] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.297693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.297826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.305227] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a482dc33-1078-4fb7-8fcb-21990f415f82 in Status: IN_PROGRESS for 2s [ 1179.571658] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-452 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.571907] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.571998] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.572324] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.572534] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.572697] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.572818] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.573194] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.573367] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.573581] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.573698] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.573809] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.573921] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.574145] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.574304] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.574452] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.594857] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.595041] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1179.595186] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.595361] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.595675] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-ee2d251a-047e-4b2b-b5a3-f66b16e67649 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.595905] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-ee2d251a-047e-4b2b-b5a3-f66b16e67649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.596070] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-ee2d251a-047e-4b2b-b5a3-f66b16e67649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.596391] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-ee2d251a-047e-4b2b-b5a3-f66b16e67649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.596535] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee2d251a-047e-4b2b-b5a3-f66b16e67649',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.695038] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.725042] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 in Status: SUCCESS [ 1179.725186] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 deletion is rescheduled due to dependency. [ 1179.725277] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.725440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.725655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.725842] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.725957] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.726054] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.726193] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.726284] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.726358] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.726457] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.727545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.727545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.729877] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.730010] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.730091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.730247] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.730330] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.730421] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.888306] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 1179.888306] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 deletion is rescheduled due to dependency. [ 1179.888306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.099460] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.099785] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.099922] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.100418] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.100666] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.100971] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port ee2d251a-047e-4b2b-b5a3-f66b16e67649 not found, creating... [ 1180.101333] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.101516] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.101640] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.101897] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.102052] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.102495] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.102699] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.102832] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.103159] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.103322] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.103515] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: ee2d251a-047e-4b2b-b5a3-f66b16e67649 is going to be created. [ 1180.126742] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.126977] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.127124] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.127437] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.127685] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.127939] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-ee2d251a-047e-4b2b-b5a3-f66b16e67649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.197799] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.232052] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ddcb2b-491d-450f-80bc-7c6250b005e1 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.232271] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.232475] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.232585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.232688] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.232952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.233060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.233259] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.233355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.233409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.233631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.233735] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.233838] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 is going to be updated. [ 1180.276484] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.276680] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.276753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.277014] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.277173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.288137] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 in Status: IN_PROGRESS for 2s [ 1180.700468] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.700468] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.700468] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.700783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.700937] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.701015] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1180.727077] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.727247] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.727295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.727627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.727627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.735596] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1180.834682] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-941 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.835019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.835019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.836090] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.836090] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.836090] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.836090] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.836090] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.836275] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.837840] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1180.838115] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1180.838278] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1180.838399] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1180.838526] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1180.838645] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1180.838787] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1180.857146] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1180.861035] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1180.861035] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1180.861035] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.861035] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.861035] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.861035] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.861035] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.861035] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('738d9811-b8b5-4c9a-bc1d-89ea310f24fa',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.169272] env[71140]: INFO networking_nsxv3.common.synchronization [req-737d821b-ce93-4719-b99d-913f8d29300f req-6457555b-b93a-4231-850f-787209a8e54e service nova] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_rules [ 1181.169614] env[71140]: INFO networking_nsxv3.common.synchronization [req-737d821b-ce93-4719-b99d-913f8d29300f req-6457555b-b93a-4231-850f-787209a8e54e service nova] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1181.169614] env[71140]: INFO networking_nsxv3.common.synchronization [req-737d821b-ce93-4719-b99d-913f8d29300f req-6457555b-b93a-4231-850f-787209a8e54e service nova] Enqueued Resource ID: ee2d251a-047e-4b2b-b5a3-f66b16e67649 with Priority: HIGHEST for action port [ 1181.170069] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_rules [ 1181.170199] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1181.170288] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2d251a-047e-4b2b-b5a3-f66b16e67649 with Priority: HIGHEST for action port [ 1181.170628] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.171524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.171524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.171524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.171524] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.171945] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.172053] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.172243] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee2d251a-047e-4b2b-b5a3-f66b16e67649 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.172334] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee2d251a-047e-4b2b-b5a3-f66b16e67649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.172420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee2d251a-047e-4b2b-b5a3-f66b16e67649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.172591] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee2d251a-047e-4b2b-b5a3-f66b16e67649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.172678] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee2d251a-047e-4b2b-b5a3-f66b16e67649',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.316079] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a482dc33-1078-4fb7-8fcb-21990f415f82 in Status: SUCCESS [ 1181.316079] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a482dc33-1078-4fb7-8fcb-21990f415f82 deletion is rescheduled due to dependency. [ 1181.316079] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a482dc33-1078-4fb7-8fcb-21990f415f82" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.364896] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.365078] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.365078] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.365358] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.365634] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.365704] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 738d9811-b8b5-4c9a-bc1d-89ea310f24fa not found, creating... [ 1181.366091] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.366232] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.366327] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.367169] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.371021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.371021] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.371021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.371021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.371021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.371021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.371021] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 738d9811-b8b5-4c9a-bc1d-89ea310f24fa is going to be created. [ 1181.388636] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.388872] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.389015] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.389305] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.390791] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.391097] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.677106] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.677281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.677527] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee2d251a-047e-4b2b-b5a3-f66b16e67649 with status ACTIVE [ 1181.677867] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.677966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.677966] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.678193] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.678329] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.678611] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.678761] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.678890] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.679045] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.679194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.679432] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.679641] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.679719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.680024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.680024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.680678] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee2d251a-047e-4b2b-b5a3-f66b16e67649 is going to be updated. [ 1181.700284] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.700737] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.700834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.701324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.701524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.701773] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee2d251a-047e-4b2b-b5a3-f66b16e67649" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.098800] env[71140]: INFO networking_nsxv3.common.synchronization [req-a57a8b51-a350-4b22-b0b0-e236cdb18a0b req-b2286211-a8f0-4999-a966-6b0a1f1191cc service nova] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_rules [ 1182.098982] env[71140]: INFO networking_nsxv3.common.synchronization [req-a57a8b51-a350-4b22-b0b0-e236cdb18a0b req-b2286211-a8f0-4999-a966-6b0a1f1191cc service nova] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1182.099147] env[71140]: INFO networking_nsxv3.common.synchronization [req-a57a8b51-a350-4b22-b0b0-e236cdb18a0b req-b2286211-a8f0-4999-a966-6b0a1f1191cc service nova] Enqueued Resource ID: 738d9811-b8b5-4c9a-bc1d-89ea310f24fa with Priority: HIGHEST for action port [ 1182.099387] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_rules [ 1182.099512] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1182.099641] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738d9811-b8b5-4c9a-bc1d-89ea310f24fa with Priority: HIGHEST for action port [ 1182.100562] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.100690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.100758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.100954] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.101045] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.101840] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.101942] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.102027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.102198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.102346] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.102441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.102499] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.102638] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.102725] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.102814] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.103525] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.103777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.103777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.103917] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.103917] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('738d9811-b8b5-4c9a-bc1d-89ea310f24fa',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.298471] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 in Status: SUCCESS [ 1182.298471] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 deletion is rescheduled due to dependency. [ 1182.298471] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.298974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.299194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.299441] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.299644] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.299748] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.300423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.300423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.300423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.300423] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ddcb2b-491d-450f-80bc-7c6250b005e1 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.300423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.300423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.300861] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.300988] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.301136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.301236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.301657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.301657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.301657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.301657] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.605581] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.605778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.605924] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 738d9811-b8b5-4c9a-bc1d-89ea310f24fa with status ACTIVE [ 1182.606102] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.606205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.606270] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.606480] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.606626] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.606741] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.606834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.606889] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.607065] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.607175] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.607387] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.607483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.607538] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.607696] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.607754] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.607839] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 738d9811-b8b5-4c9a-bc1d-89ea310f24fa is going to be updated. [ 1182.609113] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.632985] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.633206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.633301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.635312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.635312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.635312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.752570] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1182.752736] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.753718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.753718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.753842] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.753900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.753949] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.754092] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.754168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.754280] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.803626] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4ddcb2b-491d-450f-80bc-7c6250b005e1: rpc.has_security_group_logging(os_id): False [ 1182.823016] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.823223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.823342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.823573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.823683] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.823911] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.824072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.824614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.824614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.824614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.824767] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.824767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.824852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.824980] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.825640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.825826] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.825937] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.826013] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.826349] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.826533] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.826591] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 is going to be updated. [ 1182.902038] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.902038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.902038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.902277] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.902358] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.918030] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 in Status: IN_PROGRESS for 2s [ 1183.111347] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.258361] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.477490] env[71140]: INFO networking_nsxv3.common.synchronization [req-3e12c5ee-9578-4cf9-a087-cde46c3f5cf3 req-23e79db0-f28c-48a1-adeb-66eafc6983f5 tempest-AttachVolumeTestJSON-775620922 tempest-AttachVolumeTestJSON-775620922-project-member] Enqueued Resource ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b with Priority: HIGHEST for action security_group_members [ 1183.478441] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b with Priority: HIGHEST for action security_group_members [ 1183.481125] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-42f38ff1-7afd-4b06-8a81-a4f009035e8b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.481125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.481125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.481125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.481125] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.481125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.481125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.481125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.481125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.481125] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42f38ff1-7afd-4b06-8a81-a4f009035e8b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.616514] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.616676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.616743] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.617069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.617069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.617177] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be updated. [ 1183.643897] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.643897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.643897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.643897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.643897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.654650] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: IN_PROGRESS for 2s [ 1183.761124] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.983653] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.983807] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.983867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.984114] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.984209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.984408] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.984505] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.984562] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.984714] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.984788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.984871] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b already deleted. [ 1183.984950] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.016668] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-990 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.016906] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-990" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.017054] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-990" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.017322] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-990" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.017591] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.017818] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.017989] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.018234] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.018387] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.018622] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1184.018744] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1184.018860] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1184.018973] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1184.019100] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1184.019215] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1184.019353] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1184.038366] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1184.038676] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1184.038781] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1184.039012] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-990" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.039394] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.039575] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.039703] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.040019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.040166] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.263397] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.263663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.263663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.263836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.263929] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.264042] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1184.291307] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.291440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.291502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.291757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.291888] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.299601] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1184.544093] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.544414] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.544531] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.544761] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.544936] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.545136] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9 not found, creating... [ 1184.545473] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.545589] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.545725] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.546061] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.546209] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.546513] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.546714] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.546870] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.547086] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.547302] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.547425] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9 is going to be created. [ 1184.567112] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.567112] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.567112] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.567112] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.567341] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.567449] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.928698] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 in Status: SUCCESS [ 1184.928938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.929158] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.929383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.929478] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4ddcb2b-491d-450f-80bc-7c6250b005e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.449131] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.449329] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.449329] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.449541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.449630] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.449726] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4ddcb2b-491d-450f-80bc-7c6250b005e1 is going to be deleted. [ 1185.460870] env[71140]: INFO networking_nsxv3.common.synchronization [req-3e12c5ee-9578-4cf9-a087-cde46c3f5cf3 req-39c345ba-65ec-45d5-b4d7-e1b7e22d8ad2 service nova] Enqueued Resource ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b with Priority: HIGHEST for action security_group_rules [ 1185.461077] env[71140]: INFO networking_nsxv3.common.synchronization [req-3e12c5ee-9578-4cf9-a087-cde46c3f5cf3 req-39c345ba-65ec-45d5-b4d7-e1b7e22d8ad2 service nova] Enqueued Resource ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b with Priority: HIGHEST for action security_group_members [ 1185.461157] env[71140]: INFO networking_nsxv3.common.synchronization [req-3e12c5ee-9578-4cf9-a087-cde46c3f5cf3 req-39c345ba-65ec-45d5-b4d7-e1b7e22d8ad2 service nova] Enqueued Resource ID: 3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9 with Priority: HIGHEST for action port [ 1185.461384] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b with Priority: HIGHEST for action security_group_rules [ 1185.461513] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b with Priority: HIGHEST for action security_group_members [ 1185.461609] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9 with Priority: HIGHEST for action port [ 1185.462189] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.462291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.462354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.462554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.462639] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42f38ff1-7afd-4b06-8a81-a4f009035e8b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.468494] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-42f38ff1-7afd-4b06-8a81-a4f009035e8b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.468670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.468737] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.468938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.469112] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.469217] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.469283] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.469472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.469472] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.469600] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42f38ff1-7afd-4b06-8a81-a4f009035e8b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.470432] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.470583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.470644] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.470764] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.470863] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.521441] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.521691] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.521691] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.521917] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.522034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.522160] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4ddcb2b-491d-450f-80bc-7c6250b005e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.665753] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 1185.666279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.666359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.666705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.667069] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.667264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.667363] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.667614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.667706] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.667844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.667978] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.976733] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9 with status ACTIVE [ 1185.976813] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.977023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.977023] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.977218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.977307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.977499] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.977600] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.977780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.978707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.978770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.978929] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.979091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.979091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.979240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.979312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.979403] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9 is going to be updated. [ 1185.980710] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-42f38ff1-7afd-4b06-8a81-a4f009035e8b taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.980820] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.980973] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42f38ff1-7afd-4b06-8a81-a4f009035e8b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.998657] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.998822] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.998886] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.999108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.999243] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.999396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3feccd2a-835d-48f6-a9cc-bf5b5aadcaa9" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.171402] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.171566] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.171617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.171810] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.172134] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.172134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.172134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.172320] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.172351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.172441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.172588] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.172790] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.172790] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.172964] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.173039] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.173119] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.173173] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.173312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.173389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.173469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.173575] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.309104] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1186.309334] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.309485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.309701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.309895] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.310042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.310095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.310254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.310331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.310417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.310505] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.484816] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42f38ff1-7afd-4b06-8a81-a4f009035e8b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.677311] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7d76214-330f-43f9-a3bd-c36a084b6ab5: rpc.has_security_group_logging(os_id): False [ 1186.694997] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.694997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.694997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.695211] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.695294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.695536] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.695665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.695751] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.695950] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.696063] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.696306] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.696520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.696520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.696695] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.696799] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.697083] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.697314] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.697314] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.697458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.697555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.697660] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be updated. [ 1186.806309] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.806476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.806561] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.806842] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.807255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.812977] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.813122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.813191] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.813373] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.813532] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.813627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.813695] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.813891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.813949] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.814047] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.814190] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.814293] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.814352] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.814487] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.814621] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.814710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.814765] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.814897] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.814978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.815058] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.815147] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.819067] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: IN_PROGRESS for 2s [ 1186.988589] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.988851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.988949] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.989289] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.990932] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.990932] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b is going to be created. [ 1187.014584] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.014858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.014858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.015128] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.015333] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.025858] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b in Status: UNINITIALIZED for 2s [ 1187.317711] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e8717ad-052a-4a86-b223-df55dd81c619: rpc.has_security_group_logging(os_id): False [ 1187.335664] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.335876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.335876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.336096] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.352950] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.353217] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.353338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.353404] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.353609] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.353694] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.353893] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.353992] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.354065] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.354365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.354365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.354499] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.354550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.354593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.354739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.354814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.354939] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1187.410428] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.410614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.410614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.410844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.411052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.427415] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1188.833256] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 1188.833525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.039029] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b in Status: SUCCESS [ 1189.039029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.039029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.039029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.039029] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.039453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.039623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.039871] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.040136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.040355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.040539] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42f38ff1-7afd-4b06-8a81-a4f009035e8b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.442141] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1189.442291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.543841] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42f38ff1-7afd-4b06-8a81-a4f009035e8b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.046960] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42f38ff1-7afd-4b06-8a81-a4f009035e8b: rpc.has_security_group_logging(os_id): False [ 1190.067182] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.067182] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.067182] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.067182] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.067182] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.067182] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.067182] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.067182] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.067182] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.067182] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.067182] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b is going to be created. [ 1190.132155] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.132155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.132155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.132155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.132155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.141161] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b in Status: IN_PROGRESS for 2s [ 1190.462902] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1190.463153] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1191.490191] env[71140]: INFO networking_nsxv3.common.synchronization [req-51f54f80-e129-4e80-8dff-99465dda3e39 req-0e24e546-fc8d-452b-a710-ae9d2addc9b4 tempest-ServerActionsTestJSON-2079743708 tempest-ServerActionsTestJSON-2079743708-project-member] Enqueued Resource ID: 638f5992-652b-4deb-89c8-b409cb49bf0a with Priority: HIGHEST for action security_group_members [ 1191.490717] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638f5992-652b-4deb-89c8-b409cb49bf0a with Priority: HIGHEST for action security_group_members [ 1191.491036] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-638f5992-652b-4deb-89c8-b409cb49bf0a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.491159] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.491229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.491639] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.491808] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.491914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.491974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.492147] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.492231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.492323] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('638f5992-652b-4deb-89c8-b409cb49bf0a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.996538] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.996770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.996849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.997085] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.016648] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.016920] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.017053] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.017523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.017523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.017523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.017523] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 638f5992-652b-4deb-89c8-b409cb49bf0a is going to be updated. [ 1192.043273] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.043506] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.043506] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.043681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.043846] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.052484] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 638f5992-652b-4deb-89c8-b409cb49bf0a in Status: IN_PROGRESS for 2s [ 1192.156984] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b in Status: SUCCESS [ 1192.157244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.704636] env[71140]: INFO networking_nsxv3.common.synchronization [req-84c0d320-4af3-46fe-b93f-20bc69304a0b req-ba8f2e96-f058-4393-bf17-f77c1d65f46a tempest-ServersTestJSON-1092316267 tempest-ServersTestJSON-1092316267-project-member] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1193.705248] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1193.705600] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.705750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.705826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.706177] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.706382] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.706510] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.706576] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.706774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.706901] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.707035] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.062114] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 638f5992-652b-4deb-89c8-b409cb49bf0a in Status: SUCCESS [ 1194.062916] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 638f5992-652b-4deb-89c8-b409cb49bf0a deletion is rescheduled due to dependency. [ 1194.062916] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.209416] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.712333] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.214605] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.214757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.214856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.215157] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.215236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.215314] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1195.247187] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.247347] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.247530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.247655] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.248408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.259610] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1196.829658] env[71140]: INFO networking_nsxv3.common.synchronization [req-ea95bac7-9b2d-48f0-bbd5-ee5a23475bab req-f4982d31-211c-48aa-8e53-305c6eafeb35 tempest-DeleteServersTestJSON-1199867382 tempest-DeleteServersTestJSON-1199867382-project-member] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1196.830310] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGHEST for action security_group_members [ 1196.830642] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.830851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.830921] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.831148] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.831313] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.831412] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.831466] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.831619] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.832091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.832091] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.270022] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1197.270280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.334529] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.334718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.334718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.334912] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.354523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.354800] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.354983] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.355071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.355247] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.355333] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.355434] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be updated. [ 1197.377306] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.377465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.377511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.378516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.378516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.387966] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: IN_PROGRESS for 2s [ 1199.402589] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c549bd3-468a-4655-b709-3480ff374e11 in Status: SUCCESS [ 1199.402898] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 deletion is rescheduled due to dependency. [ 1199.402898] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.056808] env[71140]: INFO networking_nsxv3.common.synchronization [req-1ae94808-34e9-4754-9207-257b8119457f req-dd507345-2197-41f8-a2fa-f9cb614674ff tempest-ServersTestJSON-1092316267 tempest-ServersTestJSON-1092316267-project-member] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1200.057762] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1200.058090] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.058220] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.058285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.058478] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.058627] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.058721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.058779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.058924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.059094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.059151] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.508825] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-941 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.509288] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.509288] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.509431] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.509846] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.509984] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.510068] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.510258] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.510413] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.510630] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.510748] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1200.510928] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1200.511066] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1200.511204] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.511317] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1200.511453] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1200.530190] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1200.530349] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1200.530474] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1200.530643] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-941" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.530979] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.531185] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.531310] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.531557] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.531697] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('738d9811-b8b5-4c9a-bc1d-89ea310f24fa',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.561125] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.034368] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.034643] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.034777] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.035122] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.035312] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.035638] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.035801] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.035928] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.036182] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.036328] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.036620] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.036779] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.036902] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.037127] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.037268] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.037412] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 738d9811-b8b5-4c9a-bc1d-89ea310f24fa is going to be updated. [ 1201.060359] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.060592] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.060685] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.061197] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.061238] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.061513] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.062975] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.565138] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.565547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.565547] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.565640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.565675] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.565831] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1201.593517] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.593664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.593734] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.593938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.594094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.602308] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1201.813809] env[71140]: INFO networking_nsxv3.common.synchronization [req-71123a3a-3f74-46b9-9f7f-f1f7823ce3af req-98209d76-e833-4fa6-8564-f4d262deff85 service nova] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_rules [ 1201.814013] env[71140]: INFO networking_nsxv3.common.synchronization [req-71123a3a-3f74-46b9-9f7f-f1f7823ce3af req-98209d76-e833-4fa6-8564-f4d262deff85 service nova] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1201.814200] env[71140]: INFO networking_nsxv3.common.synchronization [req-71123a3a-3f74-46b9-9f7f-f1f7823ce3af req-98209d76-e833-4fa6-8564-f4d262deff85 service nova] Enqueued Resource ID: 738d9811-b8b5-4c9a-bc1d-89ea310f24fa with Priority: HIGHEST for action port [ 1201.814869] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_rules [ 1201.814954] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1201.815129] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738d9811-b8b5-4c9a-bc1d-89ea310f24fa with Priority: HIGHEST for action port [ 1201.815432] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.815614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.815711] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.815945] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.816064] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.817104] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.817246] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.817354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.817586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.817809] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.817940] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.818014] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.818184] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.818269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.818361] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.819365] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.819657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.819657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.820015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.820015] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('738d9811-b8b5-4c9a-bc1d-89ea310f24fa',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.321451] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.322542] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.322652] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.322812] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 738d9811-b8b5-4c9a-bc1d-89ea310f24fa with status ACTIVE [ 1202.325729] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.325729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.325729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.325729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.325729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.325729] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.325729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.325729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.325729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.325729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.325729] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.325729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.325729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.325729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.325729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.327122] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 738d9811-b8b5-4c9a-bc1d-89ea310f24fa is going to be updated. [ 1202.345617] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.345828] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.345828] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.346029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.346160] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.346601] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-738d9811-b8b5-4c9a-bc1d-89ea310f24fa" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.828059] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.331390] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.331554] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.331628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.331881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.331976] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.332096] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be updated. [ 1203.366054] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.366218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.366290] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.366508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.366653] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.377439] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: IN_PROGRESS for 2s [ 1203.612674] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1203.612930] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.391084] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 1205.391459] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.391508] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.391716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.391995] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.392134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.392134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.392298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.392378] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.392467] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.392561] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.895258] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.895380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.895527] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.895681] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.895904] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.896072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.896153] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.896284] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.896379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.896469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.897493] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.897493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.897493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.897493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.897493] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.897493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.897493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.897493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.898088] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.898088] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.898088] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.029828] env[71140]: INFO networking_nsxv3.common.synchronization [None req-48199550-f52e-4f1e-91d5-aecd11270f4d None None] Enqueued Resource ID: f7d68862-7afb-40d5-bc87-c2fea76dffaf with Priority: HIGHEST for action port [ 1206.030168] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7d68862-7afb-40d5-bc87-c2fea76dffaf with Priority: HIGHEST for action port [ 1206.031244] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7d68862-7afb-40d5-bc87-c2fea76dffaf taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.031375] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7d68862-7afb-40d5-bc87-c2fea76dffaf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.031436] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7d68862-7afb-40d5-bc87-c2fea76dffaf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.031789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7d68862-7afb-40d5-bc87-c2fea76dffaf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.031918] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7d68862-7afb-40d5-bc87-c2fea76dffaf',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.403910] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7d76214-330f-43f9-a3bd-c36a084b6ab5: rpc.has_security_group_logging(os_id): False [ 1206.421990] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.422491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.422582] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.422776] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.422864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.423117] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.423259] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.423321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.423475] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.423552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.424458] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.424458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.424458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.424458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.425863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.425863] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.425863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.425863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.425863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.425863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.425863] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be updated. [ 1206.487202] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.487202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.487202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.487202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.487202] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.501018] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: IN_PROGRESS for 2s [ 1206.535516] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7d68862-7afb-40d5-bc87-c2fea76dffaf [ 1206.535516] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.535516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.535516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.535516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.535516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.535516] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7d68862-7afb-40d5-bc87-c2fea76dffaf already deleted. [ 1206.535516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7d68862-7afb-40d5-bc87-c2fea76dffaf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.316289] env[71140]: INFO networking_nsxv3.common.synchronization [None req-412b2d9d-7197-4321-879b-7eb04a9a9874 tempest-ServerActionsV293TestJSON-699960627 tempest-ServerActionsV293TestJSON-699960627-project-member] Enqueued Resource ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a with Priority: HIGHEST for action security_group_rules [ 1207.316998] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a with Priority: HIGHEST for action security_group_rules [ 1207.317865] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-933bc47a-63e8-4a49-aa3e-e491140ef01a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.317865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.317865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.317865] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.317865] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('933bc47a-63e8-4a49-aa3e-e491140ef01a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.408124] env[71140]: INFO networking_nsxv3.common.synchronization [None req-6c3ad2c2-7831-480b-874f-269426dc69ea tempest-ServerActionsV293TestJSON-699960627 tempest-ServerActionsV293TestJSON-699960627-project-member] Enqueued Resource ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a with Priority: HIGHEST for action security_group_rules [ 1207.408721] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a with Priority: HIGHEST for action security_group_rules [ 1207.409121] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-933bc47a-63e8-4a49-aa3e-e491140ef01a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.409239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.840026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.840026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.840026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.840026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.840026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.840026] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a already deleted. [ 1207.840026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.840026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.840026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.840026] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('933bc47a-63e8-4a49-aa3e-e491140ef01a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.270676] env[71140]: INFO networking_nsxv3.common.synchronization [None req-1f14a7f1-38ec-4a11-b8f7-1075a845a9d4 None None] Enqueued Resource ID: 4690f600-53f9-433c-b19f-4d790c7e43ec with Priority: HIGHEST for action port [ 1208.271320] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4690f600-53f9-433c-b19f-4d790c7e43ec with Priority: HIGHEST for action port [ 1208.271673] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-4690f600-53f9-433c-b19f-4d790c7e43ec taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.271802] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4690f600-53f9-433c-b19f-4d790c7e43ec" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.271926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4690f600-53f9-433c-b19f-4d790c7e43ec" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.272314] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4690f600-53f9-433c-b19f-4d790c7e43ec" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.272417] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4690f600-53f9-433c-b19f-4d790c7e43ec',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.359209] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.359346] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.359455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.359644] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.359736] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.359840] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a already deleted. [ 1208.359920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.523143] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 1208.523622] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.775278] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4690f600-53f9-433c-b19f-4d790c7e43ec [ 1208.775517] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.775649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.775716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.775945] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.776078] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.776144] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4690f600-53f9-433c-b19f-4d790c7e43ec already deleted. [ 1208.776223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4690f600-53f9-433c-b19f-4d790c7e43ec" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.671674] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.672163] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-600" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.672373] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-600" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.672717] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-600" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.673058] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.673265] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.673423] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.673700] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.673870] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.674181] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1211.674403] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1211.674546] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1211.674694] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1211.674844] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1211.674975] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1211.675232] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1211.695153] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1211.695442] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1211.695655] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1211.695972] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-600" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.696461] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-82b7d1f8-9039-4fe9-9280-b798fc140b63 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.696784] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-82b7d1f8-9039-4fe9-9280-b798fc140b63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.696988] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-82b7d1f8-9039-4fe9-9280-b798fc140b63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.697462] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-82b7d1f8-9039-4fe9-9280-b798fc140b63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.697676] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82b7d1f8-9039-4fe9-9280-b798fc140b63',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.200011] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.200346] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.200510] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.200821] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.201068] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.201576] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.201576] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.201723] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.202012] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.202209] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.202568] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.202786] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.202929] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.203226] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.203408] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.203601] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 82b7d1f8-9039-4fe9-9280-b798fc140b63 is going to be updated. [ 1212.224048] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.224316] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.224426] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.224705] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.224912] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.225170] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-82b7d1f8-9039-4fe9-9280-b798fc140b63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.963866] env[71140]: INFO networking_nsxv3.common.synchronization [req-3e82c461-0a58-4620-8cac-a5ff797ad5ae req-5237ce1d-9624-4c48-b1b5-4a02d38ff6e0 service nova] Enqueued Resource ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 with Priority: HIGHEST for action security_group_rules [ 1212.964170] env[71140]: INFO networking_nsxv3.common.synchronization [req-3e82c461-0a58-4620-8cac-a5ff797ad5ae req-5237ce1d-9624-4c48-b1b5-4a02d38ff6e0 service nova] Enqueued Resource ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 with Priority: HIGHEST for action security_group_members [ 1212.964356] env[71140]: INFO networking_nsxv3.common.synchronization [req-3e82c461-0a58-4620-8cac-a5ff797ad5ae req-5237ce1d-9624-4c48-b1b5-4a02d38ff6e0 service nova] Enqueued Resource ID: 82b7d1f8-9039-4fe9-9280-b798fc140b63 with Priority: HIGHEST for action port [ 1212.964937] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 with Priority: HIGHEST for action security_group_rules [ 1212.966933] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 with Priority: HIGHEST for action security_group_members [ 1212.966933] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82b7d1f8-9039-4fe9-9280-b798fc140b63 with Priority: HIGHEST for action port [ 1212.967176] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.967312] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.967398] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.967709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.967815] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f4aefa9-35c0-4c8a-bade-f3a9b8c62528',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.969478] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.969567] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.969625] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.969811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.971026] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.971026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.971026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.971026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.971026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.971026] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f4aefa9-35c0-4c8a-bade-f3a9b8c62528',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.971436] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-82b7d1f8-9039-4fe9-9280-b798fc140b63 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.971557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82b7d1f8-9039-4fe9-9280-b798fc140b63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.971627] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82b7d1f8-9039-4fe9-9280-b798fc140b63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.971779] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82b7d1f8-9039-4fe9-9280-b798fc140b63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.971852] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82b7d1f8-9039-4fe9-9280-b798fc140b63',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.477811] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f4aefa9-35c0-4c8a-bade-f3a9b8c62528',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.478182] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.478349] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.478711] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82b7d1f8-9039-4fe9-9280-b798fc140b63 with status ACTIVE [ 1213.478908] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.479042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.479121] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.479360] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.479446] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.479644] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.479750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.479825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.479989] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.480109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.480391] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.480458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.480458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.480619] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.480693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.480777] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82b7d1f8-9039-4fe9-9280-b798fc140b63 is going to be updated. [ 1213.499029] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.499176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.499242] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.499445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.499603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.499767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82b7d1f8-9039-4fe9-9280-b798fc140b63" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.979229] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f4aefa9-35c0-4c8a-bade-f3a9b8c62528',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.481232] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.481368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.481422] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.481649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.481733] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.481832] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 is going to be updated. [ 1214.512573] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.512797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.512851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.513037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.513185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.522655] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 in Status: IN_PROGRESS for 2s [ 1216.533718] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 in Status: SUCCESS [ 1216.534124] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.534174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.534376] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.534594] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.534701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.534746] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.534900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.534981] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.535108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.535207] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f4aefa9-35c0-4c8a-bade-f3a9b8c62528',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.039518] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f4aefa9-35c0-4c8a-bade-f3a9b8c62528',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.438177] env[71140]: INFO networking_nsxv3.common.synchronization [req-8671b1e4-c08a-4ea2-a885-cf9cfa9a6c99 req-a88db118-4df5-40fb-98f7-005b7bd040bf tempest-ServersTestJSON-1092316267 tempest-ServersTestJSON-1092316267-project-member] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1217.438177] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1217.438177] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.438177] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.438177] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.438177] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.438177] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.438177] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.444014] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.444014] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.444014] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.444014] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.544032] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528: rpc.has_security_group_logging(os_id): False [ 1217.560761] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.560967] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.561051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.561346] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.583039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.583436] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.583648] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.583739] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.583968] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.584067] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.585451] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 is going to be updated. [ 1217.672028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.672028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.672028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.672028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.672028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.694755] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 in Status: IN_PROGRESS for 2s [ 1217.904988] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-452 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.905256] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.905412] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.905720] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.906017] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.913345] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.913345] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.913345] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.913345] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.913345] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1217.913345] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1217.913345] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1217.913345] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1217.913345] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1217.913345] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1217.913345] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1217.932684] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1217.933283] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1217.933283] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1217.934469] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.934669] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-acadb43b-a788-4cc9-ac70-7193b6d6e514 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.934869] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-acadb43b-a788-4cc9-ac70-7193b6d6e514" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.935499] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-acadb43b-a788-4cc9-ac70-7193b6d6e514" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.935499] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-acadb43b-a788-4cc9-ac70-7193b6d6e514" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.939223] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acadb43b-a788-4cc9-ac70-7193b6d6e514',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.947795] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.443110] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.443460] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.443613] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.443933] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.449020] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.449274] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port acadb43b-a788-4cc9-ac70-7193b6d6e514 not found, creating... [ 1218.449938] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.450191] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.450299] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.450570] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.450730] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.451083] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.451273] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.451402] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.451633] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.451781] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.451927] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: acadb43b-a788-4cc9-ac70-7193b6d6e514 is going to be created. [ 1218.453637] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.477021] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.477021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.477021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.477021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.477021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.477021] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-acadb43b-a788-4cc9-ac70-7193b6d6e514" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.775184] env[71140]: INFO networking_nsxv3.common.synchronization [req-c7c430a2-1a86-48c2-9fec-22dce8fa3bf5 req-1e85695c-1bda-40a7-a2f4-8daa77c19077 tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_members [ 1218.775184] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_members [ 1218.775590] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-83375852-3b13-42bc-b95c-09c5949dc69a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.775590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.775759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.775838] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.776061] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.776164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.776223] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.776793] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.776793] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.776793] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.958934] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.959117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.959205] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.959537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.959674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.959786] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1219.001198] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.001405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.001474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.002065] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.002217] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.021776] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1219.215363] env[71140]: INFO networking_nsxv3.common.synchronization [req-8671b1e4-c08a-4ea2-a885-cf9cfa9a6c99 req-f445b2a6-813d-4ab7-a130-9cb3f744bc0e service nova] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_rules [ 1219.215363] env[71140]: INFO networking_nsxv3.common.synchronization [req-8671b1e4-c08a-4ea2-a885-cf9cfa9a6c99 req-f445b2a6-813d-4ab7-a130-9cb3f744bc0e service nova] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1219.215446] env[71140]: INFO networking_nsxv3.common.synchronization [req-8671b1e4-c08a-4ea2-a885-cf9cfa9a6c99 req-f445b2a6-813d-4ab7-a130-9cb3f744bc0e service nova] Enqueued Resource ID: acadb43b-a788-4cc9-ac70-7193b6d6e514 with Priority: HIGHEST for action port [ 1219.215647] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_rules [ 1219.215774] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1219.215869] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acadb43b-a788-4cc9-ac70-7193b6d6e514 with Priority: HIGHEST for action port [ 1219.216522] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.216646] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.216711] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.216911] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.216993] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.218208] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.218308] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.218508] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-acadb43b-a788-4cc9-ac70-7193b6d6e514 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.218607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acadb43b-a788-4cc9-ac70-7193b6d6e514" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.218671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acadb43b-a788-4cc9-ac70-7193b6d6e514" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.218888] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acadb43b-a788-4cc9-ac70-7193b6d6e514" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.218935] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acadb43b-a788-4cc9-ac70-7193b6d6e514',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.278615] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.709420] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 in Status: SUCCESS [ 1219.710281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.722469] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acadb43b-a788-4cc9-ac70-7193b6d6e514 with status ACTIVE [ 1219.722706] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.722868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.722938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.723264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.723444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.723656] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.723817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.723817] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.724042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.724171] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.724402] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.724503] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.724568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.724734] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.724834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.724974] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acadb43b-a788-4cc9-ac70-7193b6d6e514 is going to be updated. [ 1219.726261] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.726401] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.744074] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.744299] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.744299] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.744550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.744705] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.744870] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acadb43b-a788-4cc9-ac70-7193b6d6e514" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.781568] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.286233] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.286233] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.286233] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.286233] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.286233] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.286233] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83375852-3b13-42bc-b95c-09c5949dc69a is going to be updated. [ 1220.314039] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.314039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.314039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.314039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.314039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.322831] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83375852-3b13-42bc-b95c-09c5949dc69a in Status: IN_PROGRESS for 2s [ 1220.422009] env[71140]: INFO networking_nsxv3.common.synchronization [req-cfd0c1cb-bf7e-497a-923d-d07f55d6e2e1 req-5ca074e4-3ca2-40f9-a2fe-aedd1a9e9004 tempest-AttachVolumeNegativeTest-950002537 tempest-AttachVolumeNegativeTest-950002537-project-member] Enqueued Resource ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 with Priority: HIGHEST for action security_group_members [ 1220.422972] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 with Priority: HIGHEST for action security_group_members [ 1220.424337] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fe121ab-f6de-4059-bbdf-9b957346a3d3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.424337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.424337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.424337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.424337] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.424337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.424337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.424337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.424337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.424841] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fe121ab-f6de-4059-bbdf-9b957346a3d3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.926313] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.926724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.926724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.926819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.946895] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.947259] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.947396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.947396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.947580] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.947664] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.947759] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 is going to be updated. [ 1220.971226] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.971583] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.971694] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.971927] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.972091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.979863] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 in Status: IN_PROGRESS for 2s [ 1221.030737] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1221.031201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.031444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.031679] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.031883] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.032069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.032234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.032414] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.032556] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.032712] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.535264] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.037872] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.332221] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83375852-3b13-42bc-b95c-09c5949dc69a in Status: SUCCESS [ 1222.332469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.540453] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.541261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.541261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.541261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.541261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.541261] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1222.568137] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.568307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.568399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.568717] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.568892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.578349] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1222.990183] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 in Status: SUCCESS [ 1222.990378] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 deletion is rescheduled due to dependency. [ 1222.990497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.587743] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1224.588103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.588201] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.588579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.588721] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.588814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.588878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.589089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.589215] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.589330] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.589426] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.092539] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.092763] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.092763] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.092980] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.093167] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.093327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.093444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.093621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.093713] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.093805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.093957] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.094075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.094136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.094280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.094421] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.094510] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.094566] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.094701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.094775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.094856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.094943] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.424409] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1225.424638] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1225.597621] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e8717ad-052a-4a86-b223-df55dd81c619: rpc.has_security_group_logging(os_id): False [ 1225.614904] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.615103] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.615153] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.615377] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.615482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.615716] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.615851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.615921] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.616496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.616496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.616496] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.616685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.616685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.616753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.616837] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.617080] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.617211] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.617282] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.617453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.617539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.617631] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1225.672793] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.673042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.673042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.673254] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.673435] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.689287] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1227.160104] env[71140]: INFO networking_nsxv3.common.synchronization [req-5836ff79-f08a-4290-9e93-4276d458b974 req-7f22fb72-28cb-4073-8a5c-93e8f3f6a0c8 tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_members [ 1227.160630] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83375852-3b13-42bc-b95c-09c5949dc69a with Priority: HIGHEST for action security_group_members [ 1227.160930] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-83375852-3b13-42bc-b95c-09c5949dc69a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.161060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.161159] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.161362] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.161792] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.161792] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.161792] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.161792] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.161957] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.162075] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83375852-3b13-42bc-b95c-09c5949dc69a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.664163] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.664394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.664497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.664741] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.664853] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.665098] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.665207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.665271] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.665457] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.665532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.665633] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83375852-3b13-42bc-b95c-09c5949dc69a is going to be updated. [ 1227.689925] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.690083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.690130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.690329] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.690465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.699632] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83375852-3b13-42bc-b95c-09c5949dc69a in Status: IN_PROGRESS for 2s [ 1227.708748] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1227.708961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.711635] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83375852-3b13-42bc-b95c-09c5949dc69a in Status: SUCCESS [ 1229.712029] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83375852-3b13-42bc-b95c-09c5949dc69a deletion is rescheduled due to dependency. [ 1229.712029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83375852-3b13-42bc-b95c-09c5949dc69a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.934212] env[71140]: INFO networking_nsxv3.common.synchronization [req-7e203355-6dfb-4fce-8349-a0d235e91628 req-f62bb6c4-9402-43ac-b0a9-2824d2545d5d tempest-ServerActionsTestOtherA-289074452 tempest-ServerActionsTestOtherA-289074452-project-member] Enqueued Resource ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 with Priority: HIGHEST for action security_group_members [ 1229.934737] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 with Priority: HIGHEST for action security_group_members [ 1229.936974] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-84ef6ff9-0b29-4536-8581-a65788a9e9d0 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.936974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.936974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.936974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.936974] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.936974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.936974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.937453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.937453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.937453] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84ef6ff9-0b29-4536-8581-a65788a9e9d0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.060875] env[71140]: INFO networking_nsxv3.common.synchronization [req-a57ebe0d-4dd2-4660-a66b-e0b67a205ed5 req-ae8cd34e-cd8e-43fc-8231-74db75fd55bb tempest-ServerActionsTestJSON-2079743708 tempest-ServerActionsTestJSON-2079743708-project-member] Enqueued Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 1230.061448] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 1230.061754] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.061876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.061942] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.062914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.063091] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.063198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.063259] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.063422] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.063527] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.063626] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.210172] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-210 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.210476] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-210" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.210547] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-210" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.211118] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-210" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.211118] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.211318] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.211365] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.211708] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.211829] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.212205] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1230.212205] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1230.212205] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1230.212395] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1230.212506] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1230.212751] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1230.212881] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1230.230543] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1230.230718] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1230.230863] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1230.231055] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-210" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.231438] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.231616] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.231740] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.231999] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.232164] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da4e1e9b-6b1f-40f4-9bc7-807828d08c47',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.440233] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.440233] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.440233] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.440233] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.460878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.461057] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.461209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.461311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.461532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.461663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.461807] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 is going to be updated. [ 1230.486122] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.486321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.486387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.486616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.486760] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.494721] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 in Status: IN_PROGRESS for 2s [ 1230.565454] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.565636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.565766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.566010] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.587802] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.588105] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.588289] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.588363] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.588641] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.588736] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.588891] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 is going to be updated. [ 1230.616041] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.616194] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.616267] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.616568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.616717] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.625190] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: IN_PROGRESS for 2s [ 1230.734732] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.735771] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.735771] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.735771] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.735771] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.736049] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.736284] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.736371] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.736533] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.737533] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.737533] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.737533] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.737533] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.737533] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.737823] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.737823] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: da4e1e9b-6b1f-40f4-9bc7-807828d08c47 is going to be updated. [ 1230.758932] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.759272] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.759422] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.759657] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.759877] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.760276] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.460316] env[71140]: INFO networking_nsxv3.common.synchronization [req-ddd20756-7554-4d6e-a7ea-761178607e45 req-b5fa822e-d40c-4d2f-a052-764eb1bc265e service nova] Enqueued Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_rules [ 1231.460506] env[71140]: INFO networking_nsxv3.common.synchronization [req-ddd20756-7554-4d6e-a7ea-761178607e45 req-b5fa822e-d40c-4d2f-a052-764eb1bc265e service nova] Enqueued Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_members [ 1231.460652] env[71140]: INFO networking_nsxv3.common.synchronization [req-ddd20756-7554-4d6e-a7ea-761178607e45 req-b5fa822e-d40c-4d2f-a052-764eb1bc265e service nova] Enqueued Resource ID: da4e1e9b-6b1f-40f4-9bc7-807828d08c47 with Priority: HIGHEST for action port [ 1231.460875] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_rules [ 1231.461021] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_members [ 1231.461123] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4e1e9b-6b1f-40f4-9bc7-807828d08c47 with Priority: HIGHEST for action port [ 1231.461807] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.461923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.462008] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.462268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.462368] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.463813] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.463813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.463813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.463813] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.463813] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.464359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.464359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.464359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.464359] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.464497] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.465692] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.465692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.465692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.465692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.465692] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da4e1e9b-6b1f-40f4-9bc7-807828d08c47',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.967483] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.967483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.971895] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.972687] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da4e1e9b-6b1f-40f4-9bc7-807828d08c47 with status ACTIVE [ 1231.973057] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.973057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.973057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.973261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.973421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.973524] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.973623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.973687] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.973883] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.973959] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.974537] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.974537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.974537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.974537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.974537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.974804] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da4e1e9b-6b1f-40f4-9bc7-807828d08c47 is going to be updated. [ 1231.993495] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.993707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.993782] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.994024] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.994167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.994332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da4e1e9b-6b1f-40f4-9bc7-807828d08c47" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.476537] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.503458] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 in Status: SUCCESS [ 1232.503633] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 deletion is rescheduled due to dependency. [ 1232.503744] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.634164] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: SUCCESS [ 1232.634358] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 deletion is rescheduled due to dependency. [ 1232.634476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.978919] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.979383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.979383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.980179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.980179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.980179] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 is going to be updated. [ 1233.008205] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.008390] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.008433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.008636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.008782] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.016805] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: IN_PROGRESS for 2s [ 1233.062673] env[71140]: INFO networking_nsxv3.common.synchronization [req-cea6bbf1-d8b2-4faf-b988-c790b29e2ba8 req-7166fbd9-3d0b-4768-bb11-a8b1ef7a857e tempest-ServersTestJSON-1092316267 tempest-ServersTestJSON-1092316267-project-member] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1233.063258] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1233.063582] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.063727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.063790] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.063952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.064137] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.064273] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.064351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.064512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.064588] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.068074] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.570444] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.073415] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.577101] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.577101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.577101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.577101] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.577542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.577542] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1234.612344] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.612601] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.612601] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.612795] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.612940] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.621932] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1235.027041] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: SUCCESS [ 1235.027041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.027041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.027041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.027041] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.027041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.027041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.027041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.027486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.027486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.027486] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.204761] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.205140] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.205140] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.205409] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.205682] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.205846] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.205968] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.206222] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.206374] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.206596] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.206712] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1235.206824] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1235.206934] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1235.207058] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.207168] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1235.207308] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1235.226820] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1235.226998] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1235.227131] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1235.227303] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.227653] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.227833] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.228177] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.228502] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.228608] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d01f9eba-f429-41fe-b9c7-0f3249ed16e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.530084] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.530084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.530084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.530084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.530433] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.530433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.530433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.530561] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.530603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.530689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.530857] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.531034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.531034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.531212] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.531393] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.531496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.531559] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.531703] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.531781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.531863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.531951] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.731138] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.731462] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.731609] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.731934] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.732143] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.732531] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.732727] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.732879] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.733165] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.733350] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.733742] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.733887] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.734008] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.734329] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.734488] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.734661] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: d01f9eba-f429-41fe-b9c7-0f3249ed16e1 is going to be updated. [ 1235.754632] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.754877] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.755019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.755319] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.755531] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.755766] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.034025] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8bf2e04-ddcc-43f4-b665-59a628a61547: rpc.has_security_group_logging(os_id): False [ 1236.056071] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.056071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.056071] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.056391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.078563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.078955] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.079097] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.079321] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.079395] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.079446] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.079630] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.079766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.079835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.080030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.080112] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.080293] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.080389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.080453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.080589] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.080698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.080787] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 is going to be updated. [ 1236.141499] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.141752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.141811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.142058] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.142275] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.160882] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: IN_PROGRESS for 2s [ 1236.475628] env[71140]: INFO networking_nsxv3.common.synchronization [req-7573831b-2d90-4892-8f9c-630323db2c25 req-40548167-cfa1-4341-8849-e873f21ef67c service nova] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_rules [ 1236.475917] env[71140]: INFO networking_nsxv3.common.synchronization [req-7573831b-2d90-4892-8f9c-630323db2c25 req-40548167-cfa1-4341-8849-e873f21ef67c service nova] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 1236.475992] env[71140]: INFO networking_nsxv3.common.synchronization [req-7573831b-2d90-4892-8f9c-630323db2c25 req-40548167-cfa1-4341-8849-e873f21ef67c service nova] Enqueued Resource ID: d01f9eba-f429-41fe-b9c7-0f3249ed16e1 with Priority: HIGHEST for action port [ 1236.476545] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_rules [ 1236.476688] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 1236.476784] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d01f9eba-f429-41fe-b9c7-0f3249ed16e1 with Priority: HIGHEST for action port [ 1236.479151] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.479380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.479483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.479685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.479774] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.481065] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.481623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.481623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.481623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.481823] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.481823] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.481823] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.481984] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.482048] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.482146] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.482978] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.484160] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.484256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.484406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.484812] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d01f9eba-f429-41fe-b9c7-0f3249ed16e1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.632037] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1236.632037] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.986017] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.987459] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.987584] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.987904] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d01f9eba-f429-41fe-b9c7-0f3249ed16e1 with status ACTIVE [ 1236.988085] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.988276] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.988276] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.988467] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.988578] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.988755] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.988849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.988903] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.989090] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.989165] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.990110] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.990110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.990110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.990110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.990110] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.990110] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d01f9eba-f429-41fe-b9c7-0f3249ed16e1 is going to be updated. [ 1237.010332] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.010332] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.010492] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.010606] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.010735] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.010893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d01f9eba-f429-41fe-b9c7-0f3249ed16e1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.488955] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.991447] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.991651] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.991712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.992325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.992325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.992325] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c is going to be updated. [ 1238.023337] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.023531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.023531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.024834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.024834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.032134] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: IN_PROGRESS for 2s [ 1238.137464] env[71140]: INFO networking_nsxv3.common.synchronization [None req-024f1bf3-662c-4061-aed5-3fa02dd3b7be tempest-AttachInterfacesTestJSON-285586148 tempest-AttachInterfacesTestJSON-285586148-project-member] Enqueued Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1238.138135] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 with Priority: HIGHEST for action security_group_members [ 1238.138468] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7d76214-330f-43f9-a3bd-c36a084b6ab5 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.138589] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.138660] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.138870] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.139052] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.139187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.139287] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.139432] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.139524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.139615] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7d76214-330f-43f9-a3bd-c36a084b6ab5',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.178096] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: SUCCESS [ 1238.178340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.641932] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.642396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.642396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.642496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.642607] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.642850] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.642936] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.642972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.643209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.643285] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.643366] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 is going to be updated. [ 1238.669885] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.669885] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.670030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.670170] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.670313] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.678131] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: IN_PROGRESS for 2s [ 1240.041823] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: SUCCESS [ 1240.042186] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.042421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.042421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.046021] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.046021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.046021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.046021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.046021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.046021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.046021] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.545247] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.687868] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 in Status: SUCCESS [ 1240.687945] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7d76214-330f-43f9-a3bd-c36a084b6ab5 deletion is rescheduled due to dependency. [ 1240.688065] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7d76214-330f-43f9-a3bd-c36a084b6ab5" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.866775] env[71140]: INFO networking_nsxv3.common.synchronization [req-c3abdb87-0ef1-49b5-a7c1-90d9fddb77e6 req-d34e3494-44a1-47cd-adde-c4c57fcba31c tempest-ServerActionsV293TestJSON-699960627 tempest-ServerActionsV293TestJSON-699960627-project-member] Enqueued Resource ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a with Priority: HIGHEST for action security_group_members [ 1240.866775] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a with Priority: HIGHEST for action security_group_members [ 1240.866775] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-933bc47a-63e8-4a49-aa3e-e491140ef01a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.866775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.867535] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.868095] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.868427] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.871318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.871318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.871318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.871318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.871318] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933bc47a-63e8-4a49-aa3e-e491140ef01a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.051818] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c99ec8b-0259-4916-a240-54938fc5a81c: rpc.has_security_group_logging(os_id): False [ 1241.067520] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.067827] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.067990] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.068372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.087541] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.087950] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.088073] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.088178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.088331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.088589] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.088589] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c is going to be updated. [ 1241.153637] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.153910] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.153954] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.154164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.154310] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.170275] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: IN_PROGRESS for 2s [ 1241.271031] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-515 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.271031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-515" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.271031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-515" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.271031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-515" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.271031] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.271031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.271031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.271031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.271031] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.271031] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1241.271031] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1241.271031] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1241.272126] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1241.272126] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1241.272126] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1241.272126] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1241.302324] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1241.302502] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1241.302671] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1241.302860] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-515" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.303211] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-44f46017-7ff3-4eb7-be59-0742d376e814 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.303403] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-44f46017-7ff3-4eb7-be59-0742d376e814" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.303531] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-44f46017-7ff3-4eb7-be59-0742d376e814" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.303893] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-44f46017-7ff3-4eb7-be59-0742d376e814" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.304165] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44f46017-7ff3-4eb7-be59-0742d376e814',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.372249] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.372416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.372490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.372701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.372794] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.372998] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.373147] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.373218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.373331] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.373409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.373497] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a already deleted. [ 1241.373579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.807419] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.807712] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.807816] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.808186] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.808276] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.808519] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 44f46017-7ff3-4eb7-be59-0742d376e814 not found, creating... [ 1241.808714] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.808884] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.809013] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.809261] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.809443] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.809706] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.809874] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.809996] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.810271] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.810443] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.811069] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 44f46017-7ff3-4eb7-be59-0742d376e814 is going to be created. [ 1241.829532] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.829940] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.830270] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.830371] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.830610] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.830902] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-44f46017-7ff3-4eb7-be59-0742d376e814" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.662283] env[71140]: INFO networking_nsxv3.common.synchronization [req-c3abdb87-0ef1-49b5-a7c1-90d9fddb77e6 req-e4337919-d2d2-41ec-bf51-d956126f8717 service nova] Enqueued Resource ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a with Priority: HIGHEST for action security_group_rules [ 1242.662735] env[71140]: INFO networking_nsxv3.common.synchronization [req-c3abdb87-0ef1-49b5-a7c1-90d9fddb77e6 req-e4337919-d2d2-41ec-bf51-d956126f8717 service nova] Enqueued Resource ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a with Priority: HIGHEST for action security_group_members [ 1242.662735] env[71140]: INFO networking_nsxv3.common.synchronization [req-c3abdb87-0ef1-49b5-a7c1-90d9fddb77e6 req-e4337919-d2d2-41ec-bf51-d956126f8717 service nova] Enqueued Resource ID: 44f46017-7ff3-4eb7-be59-0742d376e814 with Priority: HIGHEST for action port [ 1242.664917] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a with Priority: HIGHEST for action security_group_rules [ 1242.664917] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a with Priority: HIGHEST for action security_group_members [ 1242.664917] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f46017-7ff3-4eb7-be59-0742d376e814 with Priority: HIGHEST for action port [ 1242.664917] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-933bc47a-63e8-4a49-aa3e-e491140ef01a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.664917] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.664917] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.665435] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.665435] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('933bc47a-63e8-4a49-aa3e-e491140ef01a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.668142] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-933bc47a-63e8-4a49-aa3e-e491140ef01a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.668142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.668142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.668142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.670547] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.672080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.672198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.672410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.672529] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.672637] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933bc47a-63e8-4a49-aa3e-e491140ef01a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.674270] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-44f46017-7ff3-4eb7-be59-0742d376e814 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.676292] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44f46017-7ff3-4eb7-be59-0742d376e814" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.676292] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44f46017-7ff3-4eb7-be59-0742d376e814" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.676292] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44f46017-7ff3-4eb7-be59-0742d376e814" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.676292] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44f46017-7ff3-4eb7-be59-0742d376e814',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.177110] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('933bc47a-63e8-4a49-aa3e-e491140ef01a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.178145] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-933bc47a-63e8-4a49-aa3e-e491140ef01a taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.178250] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.178627] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44f46017-7ff3-4eb7-be59-0742d376e814 with status ACTIVE [ 1243.178920] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.179046] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.179114] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.179327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.179435] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.179617] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.179718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.179769] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.179930] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.180013] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.180193] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.180286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.180346] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.180486] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.180561] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.180789] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44f46017-7ff3-4eb7-be59-0742d376e814 is going to be updated. [ 1243.183339] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: SUCCESS [ 1243.183526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.199160] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.199307] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.199404] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.199585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.199750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.199919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44f46017-7ff3-4eb7-be59-0742d376e814" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.339841] env[71140]: INFO networking_nsxv3.common.synchronization [None req-d5180eff-97ea-407f-aa3f-368712b7f7cc None None] Enqueued Resource ID: 9099b77e-ca1f-40da-9f4d-0de0e0da2776 with Priority: HIGHEST for action port [ 1243.341230] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9099b77e-ca1f-40da-9f4d-0de0e0da2776 with Priority: HIGHEST for action port [ 1243.341230] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-9099b77e-ca1f-40da-9f4d-0de0e0da2776 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.341425] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9099b77e-ca1f-40da-9f4d-0de0e0da2776" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.341425] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9099b77e-ca1f-40da-9f4d-0de0e0da2776" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.342117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9099b77e-ca1f-40da-9f4d-0de0e0da2776" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.342307] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9099b77e-ca1f-40da-9f4d-0de0e0da2776',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.680417] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('933bc47a-63e8-4a49-aa3e-e491140ef01a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.846334] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9099b77e-ca1f-40da-9f4d-0de0e0da2776 [ 1243.846637] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.846780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.846853] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.847078] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.847174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.847271] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9099b77e-ca1f-40da-9f4d-0de0e0da2776 already deleted. [ 1243.847366] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9099b77e-ca1f-40da-9f4d-0de0e0da2776" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.881815] env[71140]: INFO networking_nsxv3.common.synchronization [req-bdf37de6-8c19-4c13-a333-58293fc5a1ca req-ab957a9a-8c24-40e5-a993-920dfc3ee115 tempest-ServerActionsTestJSON-2079743708 tempest-ServerActionsTestJSON-2079743708-project-member] Enqueued Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 1243.882450] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 1243.882637] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.882637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.882797] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.883019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.888385] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.890867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.890867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.890867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.890867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.890867] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.185749] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.185749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.185749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.185749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.185749] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.185749] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a is going to be created. [ 1244.207692] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-168 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.208167] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-168" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.211038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-168" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.211038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-168" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.211038] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.211038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.211038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.211038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.211038] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.211038] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1244.211038] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1244.211038] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1244.211038] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1244.211038] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1244.211038] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1244.211038] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1244.213680] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.213818] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.213867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.214036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.214190] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.225996] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a in Status: UNINITIALIZED for 2s [ 1244.235092] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1244.235092] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1244.235092] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1244.235092] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-168" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.235092] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-db5b406a-d270-40fe-88ff-59241b08ae14 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.235092] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-db5b406a-d270-40fe-88ff-59241b08ae14" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.235092] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-db5b406a-d270-40fe-88ff-59241b08ae14" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.235092] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-db5b406a-d270-40fe-88ff-59241b08ae14" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.235092] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db5b406a-d270-40fe-88ff-59241b08ae14',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.392946] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.392946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.392946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.392946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.392946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.392946] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.392946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.392946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.392946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.393512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.393728] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 is going to be updated. [ 1244.427700] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.429447] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.429447] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.429447] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.429447] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.441036] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: IN_PROGRESS for 2s [ 1244.740071] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.740071] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.740071] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.740071] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.740071] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.740071] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port db5b406a-d270-40fe-88ff-59241b08ae14 not found, creating... [ 1244.740071] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.740716] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.740716] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.740716] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.740716] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.740892] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.741059] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.741175] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.741413] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.741565] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.741708] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: db5b406a-d270-40fe-88ff-59241b08ae14 is going to be created. [ 1244.762937] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.763248] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.763338] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.763634] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.763935] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.764216] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-db5b406a-d270-40fe-88ff-59241b08ae14" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.267022] env[71140]: INFO networking_nsxv3.common.synchronization [None req-a2cc90da-c1bf-4189-b52b-567ea98d78cd None None] Enqueued Resource ID: 6f51f97e-40e3-46cf-8cf6-afc3e1d048bf with Priority: HIGHEST for action port [ 1245.267697] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f51f97e-40e3-46cf-8cf6-afc3e1d048bf with Priority: HIGHEST for action port [ 1245.268052] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f51f97e-40e3-46cf-8cf6-afc3e1d048bf taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.268214] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f51f97e-40e3-46cf-8cf6-afc3e1d048bf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.268286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f51f97e-40e3-46cf-8cf6-afc3e1d048bf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.268596] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f51f97e-40e3-46cf-8cf6-afc3e1d048bf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.268689] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f51f97e-40e3-46cf-8cf6-afc3e1d048bf',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.771676] env[71140]: INFO networking_nsxv3.common.synchronization [req-bdf37de6-8c19-4c13-a333-58293fc5a1ca req-be047d77-0a96-463e-8f1c-623e9a2c3f8c service nova] Enqueued Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_rules [ 1245.771921] env[71140]: INFO networking_nsxv3.common.synchronization [req-bdf37de6-8c19-4c13-a333-58293fc5a1ca req-be047d77-0a96-463e-8f1c-623e9a2c3f8c service nova] Enqueued Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 1245.772195] env[71140]: INFO networking_nsxv3.common.synchronization [req-bdf37de6-8c19-4c13-a333-58293fc5a1ca req-be047d77-0a96-463e-8f1c-623e9a2c3f8c service nova] Enqueued Resource ID: db5b406a-d270-40fe-88ff-59241b08ae14 with Priority: HIGHEST for action port [ 1245.772959] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f51f97e-40e3-46cf-8cf6-afc3e1d048bf [ 1245.773243] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.774469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.774469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.774469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.774469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.774469] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f51f97e-40e3-46cf-8cf6-afc3e1d048bf already deleted. [ 1245.774469] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f51f97e-40e3-46cf-8cf6-afc3e1d048bf" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.774469] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_rules [ 1245.774469] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 1245.774775] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db5b406a-d270-40fe-88ff-59241b08ae14 with Priority: HIGHEST for action port [ 1245.775166] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.775166] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.775344] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.775516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.775983] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.777093] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.777264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.777989] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-db5b406a-d270-40fe-88ff-59241b08ae14 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.777989] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db5b406a-d270-40fe-88ff-59241b08ae14" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.777989] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db5b406a-d270-40fe-88ff-59241b08ae14" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.778252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db5b406a-d270-40fe-88ff-59241b08ae14" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.778303] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db5b406a-d270-40fe-88ff-59241b08ae14',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.120569] env[71140]: INFO networking_nsxv3.common.synchronization [req-d80d24f9-bd9d-4a25-bd31-98830c7f2c81 req-ee549291-602c-46ea-8126-06a10a94ec7d tempest-ServerActionsTestOtherA-289074452 tempest-ServerActionsTestOtherA-289074452-project-member] Enqueued Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGHEST for action security_group_members [ 1246.124776] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGHEST for action security_group_members [ 1246.125122] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7015c2-a058-452d-bfd5-0575d4a237f8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.125250] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.125302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.125507] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.125668] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.125774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.125838] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.126021] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.126086] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.126175] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.237031] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a in Status: SUCCESS [ 1246.237392] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.239375] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.240286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.240286] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.240286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.240286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.240286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.240286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.240644] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.240644] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('933bc47a-63e8-4a49-aa3e-e491140ef01a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.280725] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.280894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.281225] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db5b406a-d270-40fe-88ff-59241b08ae14 with status ACTIVE [ 1246.281335] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.281467] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.281548] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.281760] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.281875] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.282065] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.282165] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.282227] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.282385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.283348] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.283348] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.283348] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.283348] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.283348] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.283348] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.283348] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db5b406a-d270-40fe-88ff-59241b08ae14 is going to be updated. [ 1246.308568] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.309358] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.309358] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.309358] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.309631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.309953] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db5b406a-d270-40fe-88ff-59241b08ae14" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.454732] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: SUCCESS [ 1246.455236] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 deletion is rescheduled due to dependency. [ 1246.455458] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.456012] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.456378] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.456931] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.457204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.457383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.458109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.458109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.458109] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.480123] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-53 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.480123] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.480123] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.480123] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.480123] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.480123] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.480123] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.480123] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.480833] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.481607] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1246.481894] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1246.482133] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1246.482377] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1246.482863] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1246.483112] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1246.483366] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1246.502085] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1246.502085] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1246.502085] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1246.502085] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.505029] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-101eb0df-4649-4b5f-9494-7fe199d528e6 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.505029] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-101eb0df-4649-4b5f-9494-7fe199d528e6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.505029] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-101eb0df-4649-4b5f-9494-7fe199d528e6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.505029] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-101eb0df-4649-4b5f-9494-7fe199d528e6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.505029] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('101eb0df-4649-4b5f-9494-7fe199d528e6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.632771] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.632771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.632771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.632771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.650926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.650926] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.650926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.651112] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.651230] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.651315] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.651467] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 is going to be updated. [ 1246.673202] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.673409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.673409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.673494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.673657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.683573] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 in Status: IN_PROGRESS for 2s [ 1246.742271] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('933bc47a-63e8-4a49-aa3e-e491140ef01a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.966299] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.009034] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.009034] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.009034] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.009632] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.009632] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.009632] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 101eb0df-4649-4b5f-9494-7fe199d528e6 not found, creating... [ 1247.012611] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.012611] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.012611] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.012611] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.012611] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.012611] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.012611] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.012611] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.012611] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.013380] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.013380] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 101eb0df-4649-4b5f-9494-7fe199d528e6 is going to be created. [ 1247.034750] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.034750] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.034750] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.034750] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.034750] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.034750] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-101eb0df-4649-4b5f-9494-7fe199d528e6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.245325] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 933bc47a-63e8-4a49-aa3e-e491140ef01a: rpc.has_security_group_logging(os_id): False [ 1247.266056] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.266241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.266350] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.266618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.266719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.267059] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.267172] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.267236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.267399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.267606] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.267606] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a is going to be created. [ 1247.336460] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.336460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.336460] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.336821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.336821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.347984] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a in Status: IN_PROGRESS for 2s [ 1247.470684] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.974231] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.974710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.974710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.974780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.974890] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.975039] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 is going to be updated. [ 1248.004998] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.005229] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.005327] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.005592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.005757] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.014217] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: IN_PROGRESS for 2s [ 1248.060939] env[71140]: INFO networking_nsxv3.common.synchronization [req-d80d24f9-bd9d-4a25-bd31-98830c7f2c81 req-cec54dec-dbce-4acd-bc1b-2f00491b27f5 service nova] Enqueued Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGHEST for action security_group_rules [ 1248.061135] env[71140]: INFO networking_nsxv3.common.synchronization [req-d80d24f9-bd9d-4a25-bd31-98830c7f2c81 req-cec54dec-dbce-4acd-bc1b-2f00491b27f5 service nova] Enqueued Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGHEST for action security_group_members [ 1248.061309] env[71140]: INFO networking_nsxv3.common.synchronization [req-d80d24f9-bd9d-4a25-bd31-98830c7f2c81 req-cec54dec-dbce-4acd-bc1b-2f00491b27f5 service nova] Enqueued Resource ID: 101eb0df-4649-4b5f-9494-7fe199d528e6 with Priority: HIGHEST for action port [ 1248.061967] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGHEST for action security_group_rules [ 1248.064952] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGHEST for action security_group_members [ 1248.065242] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 101eb0df-4649-4b5f-9494-7fe199d528e6 with Priority: HIGHEST for action port [ 1248.065757] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc7015c2-a058-452d-bfd5-0575d4a237f8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.065943] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.066061] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.066357] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.066484] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.071877] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7015c2-a058-452d-bfd5-0575d4a237f8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.071877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.071877] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-101eb0df-4649-4b5f-9494-7fe199d528e6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.071877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-101eb0df-4649-4b5f-9494-7fe199d528e6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.071877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-101eb0df-4649-4b5f-9494-7fe199d528e6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.071877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-101eb0df-4649-4b5f-9494-7fe199d528e6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.071877] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('101eb0df-4649-4b5f-9494-7fe199d528e6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.571987] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7015c2-a058-452d-bfd5-0575d4a237f8 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.573693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.573693] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 101eb0df-4649-4b5f-9494-7fe199d528e6 with status ACTIVE [ 1248.573693] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.573693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.573693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.573693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.573693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.573693] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.574991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.574991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.574991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.574991] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.575346] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.575518] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.575624] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.575849] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.576045] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.576586] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 101eb0df-4649-4b5f-9494-7fe199d528e6 is going to be updated. [ 1248.596092] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.596315] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.596444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.596580] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.596716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.597038] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-101eb0df-4649-4b5f-9494-7fe199d528e6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.648421] env[71140]: INFO networking_nsxv3.common.synchronization [req-733c019d-0682-44f4-8d87-26446ca824f1 req-c8b2bbe9-e275-4cad-b3c0-cee3aeab97c4 tempest-ServersTestJSON-1092316267 tempest-ServersTestJSON-1092316267-project-member] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1248.649272] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1248.649739] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.649903] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.650035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.650390] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.650826] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.650826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.650971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.651154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.651324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.651543] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.692115] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 in Status: SUCCESS [ 1248.692463] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 deletion is rescheduled due to dependency. [ 1248.692693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.692889] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.693190] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.693449] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.693679] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.693783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.693995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.694814] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.694975] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.028772] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-452 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.029136] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.029136] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.029464] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.029751] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.029926] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.030060] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.030309] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.033867] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.033867] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1249.033867] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1249.033867] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1249.033867] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1249.033867] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1249.033867] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1249.033867] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1249.050800] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1249.050961] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1249.051117] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1249.051307] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-452" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.051685] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-46704d8f-e39e-4670-a70c-09566183f37a taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.051868] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-46704d8f-e39e-4670-a70c-09566183f37a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.052089] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-46704d8f-e39e-4670-a70c-09566183f37a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.052345] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-46704d8f-e39e-4670-a70c-09566183f37a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.052568] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46704d8f-e39e-4670-a70c-09566183f37a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.157830] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.198601] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.357913] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a in Status: SUCCESS [ 1249.358980] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.557369] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.557604] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.557734] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.558039] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.558197] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.558354] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 46704d8f-e39e-4670-a70c-09566183f37a not found, creating... [ 1249.558685] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.558889] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.559033] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.559269] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.559418] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.559726] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.559888] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.560019] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.560226] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.560371] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.560518] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 46704d8f-e39e-4670-a70c-09566183f37a is going to be created. [ 1249.583732] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.583982] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.584123] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.584390] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.584618] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.584847] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-46704d8f-e39e-4670-a70c-09566183f37a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.661204] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.701588] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.025949] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: SUCCESS [ 1250.026257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.027092] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.027092] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.027092] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.027454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.027454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.027454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.027600] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.027600] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.027674] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.163634] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.164107] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.164107] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.164226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.164283] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.164389] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1250.193156] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.193251] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.193295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.193503] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.193663] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.201740] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1250.203247] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.203375] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.203446] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.203646] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.203735] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.203829] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 is going to be updated. [ 1250.226166] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.226306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.228051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.228051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.228051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.234124] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 in Status: IN_PROGRESS for 2s [ 1250.327620] env[71140]: INFO networking_nsxv3.common.synchronization [req-733c019d-0682-44f4-8d87-26446ca824f1 req-c90b2848-8d04-4c10-b889-0524be355c13 service nova] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_rules [ 1250.328053] env[71140]: INFO networking_nsxv3.common.synchronization [req-733c019d-0682-44f4-8d87-26446ca824f1 req-c90b2848-8d04-4c10-b889-0524be355c13 service nova] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1250.328150] env[71140]: INFO networking_nsxv3.common.synchronization [req-733c019d-0682-44f4-8d87-26446ca824f1 req-c90b2848-8d04-4c10-b889-0524be355c13 service nova] Enqueued Resource ID: 46704d8f-e39e-4670-a70c-09566183f37a with Priority: HIGHEST for action port [ 1250.328425] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_rules [ 1250.328637] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1250.328719] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46704d8f-e39e-4670-a70c-09566183f37a with Priority: HIGHEST for action port [ 1250.329354] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.329539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.329647] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.329881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.329968] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.330798] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.330900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.331109] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-46704d8f-e39e-4670-a70c-09566183f37a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.331214] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46704d8f-e39e-4670-a70c-09566183f37a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.331279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46704d8f-e39e-4670-a70c-09566183f37a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.331465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46704d8f-e39e-4670-a70c-09566183f37a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.331539] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46704d8f-e39e-4670-a70c-09566183f37a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.530023] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.833773] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.833952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.834212] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46704d8f-e39e-4670-a70c-09566183f37a with status ACTIVE [ 1250.834521] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.834712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.834831] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.835225] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.835399] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.835736] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.835926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.836075] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.836365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.836502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.837089] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.837291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.837407] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.837701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.837874] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.838052] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46704d8f-e39e-4670-a70c-09566183f37a is going to be updated. [ 1250.860057] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.860057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.860057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.860057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.860057] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.860690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46704d8f-e39e-4670-a70c-09566183f37a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.032849] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e62d50e-c934-4166-825a-6649880de6a7: rpc.has_security_group_logging(os_id): False [ 1251.049685] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.049832] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.049905] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.050135] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.050232] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.050477] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.050578] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.050642] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.050793] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.050871] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.050957] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 is going to be updated. [ 1251.104751] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.104918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.104973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.105233] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.105389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.115118] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: IN_PROGRESS for 2s [ 1252.211270] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1252.211724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.211724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.211967] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.212205] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.212337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.212431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.212608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.212738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.212820] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.242841] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 in Status: SUCCESS [ 1252.243039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.243206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.243413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.243600] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.243722] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.243811] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.243927] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.244017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.244102] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.244191] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.715550] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.746440] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7015c2-a058-452d-bfd5-0575d4a237f8 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.746699] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.746699] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.746899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.747084] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.747187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.747253] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.747408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.747497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.747587] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.747730] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7015c2-a058-452d-bfd5-0575d4a237f8 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.747821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.747880] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.748036] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.748184] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.748291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.748645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.748645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.748810] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.748810] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.748887] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.126751] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: SUCCESS [ 1253.127009] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.218229] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.250604] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc7015c2-a058-452d-bfd5-0575d4a237f8: rpc.has_security_group_logging(os_id): False [ 1253.267658] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.267868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.267935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.268167] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.268250] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.268467] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.268568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.268631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.268783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.268858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.269060] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.269156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.269218] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.269354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.269425] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.269637] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.269804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.269804] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.269920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.269975] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.270274] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 is going to be updated. [ 1253.325246] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.325502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.325502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.325758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.325845] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.336280] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 in Status: IN_PROGRESS for 2s [ 1253.720769] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.721130] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.721204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.721606] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.721742] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.721860] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1253.749354] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.749521] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.749603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.750029] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.750193] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.758142] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1254.679746] env[71140]: INFO networking_nsxv3.common.synchronization [req-34491fd8-83a1-478b-b398-d707bf5b47c8 req-d63453f5-188c-4408-8949-7f845bd81be0 tempest-ServerActionsTestOtherB-2025667431 tempest-ServerActionsTestOtherB-2025667431-project-member] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 1254.681019] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGHEST for action security_group_members [ 1254.681019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.681019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.681019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.681336] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.682690] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.682690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.682690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.682690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.682690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.682690] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.183968] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.184170] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.184236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.184448] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.184540] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.184744] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.184845] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.184921] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.185070] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.185405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.185405] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c is going to be updated. [ 1255.214282] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.214431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.214501] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.214710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.214856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.222364] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: IN_PROGRESS for 2s [ 1255.318666] env[71140]: INFO networking_nsxv3.common.synchronization [req-8b19558e-d5d4-4233-b3d6-e711aa495c6b req-341d9ff2-0f12-4a2a-86c8-0f1342f58d04 tempest-ServerActionsTestOtherA-289074452 tempest-ServerActionsTestOtherA-289074452-project-member] Enqueued Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGHEST for action security_group_members [ 1255.319309] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGHEST for action security_group_members [ 1255.319650] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7015c2-a058-452d-bfd5-0575d4a237f8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.319783] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.319844] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.320035] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.320191] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.320280] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.320338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.320482] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.320573] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.320692] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.348759] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 in Status: SUCCESS [ 1255.349080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.413183] env[71140]: INFO networking_nsxv3.common.synchronization [req-8b19558e-d5d4-4233-b3d6-e711aa495c6b req-341d9ff2-0f12-4a2a-86c8-0f1342f58d04 tempest-ServerActionsTestOtherA-289074452 tempest-ServerActionsTestOtherA-289074452-project-member] Enqueued Resource ID: 101eb0df-4649-4b5f-9494-7fe199d528e6 with Priority: HIGHEST for action port [ 1255.413755] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 101eb0df-4649-4b5f-9494-7fe199d528e6 with Priority: HIGHEST for action port [ 1255.414492] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-101eb0df-4649-4b5f-9494-7fe199d528e6 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.414709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-101eb0df-4649-4b5f-9494-7fe199d528e6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.414831] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-101eb0df-4649-4b5f-9494-7fe199d528e6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.415074] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-101eb0df-4649-4b5f-9494-7fe199d528e6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.415209] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('101eb0df-4649-4b5f-9494-7fe199d528e6',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.767568] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1255.767962] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.767962] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.768543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.768742] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.769077] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.769077] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.769408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.769536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.769640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.769736] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.825179] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.825179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.825179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.825179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.825179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.825179] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.825179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.825179] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.826531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.826531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.826531] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 is going to be updated. [ 1255.850165] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.850165] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.850165] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.850431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.850431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.859351] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 in Status: IN_PROGRESS for 2s [ 1255.922388] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 101eb0df-4649-4b5f-9494-7fe199d528e6 with status ACTIVE [ 1255.922651] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.922789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.922879] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.923139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.923222] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.924017] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.924017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.924017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.924017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.924017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.924017] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.924287] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.924287] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.924287] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.924380] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.924411] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 101eb0df-4649-4b5f-9494-7fe199d528e6 is going to be updated. [ 1255.952266] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.952533] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.952533] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.952777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.952925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.953109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-101eb0df-4649-4b5f-9494-7fe199d528e6" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.273190] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.273190] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.273190] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.273406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.273445] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.273520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.273585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.273745] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.273867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.273972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.274187] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.274316] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.274379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.274549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.274712] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.274806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.274877] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.275066] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.275140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.275555] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.275555] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.777809] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e8717ad-052a-4a86-b223-df55dd81c619: rpc.has_security_group_logging(os_id): False [ 1256.794948] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.795154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.795242] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.795463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.795598] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.796146] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.796146] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.796146] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.796338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.796338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.796527] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.796629] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.796743] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.796921] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.797041] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.797274] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.797379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.797471] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.797640] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.797732] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.797829] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1256.855028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.855175] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.855257] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.855476] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.855624] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.870440] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1257.231985] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c99ec8b-0259-4916-a240-54938fc5a81c in Status: SUCCESS [ 1257.232196] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c deletion is rescheduled due to dependency. [ 1257.232309] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.869082] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 in Status: SUCCESS [ 1257.869444] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 deletion is rescheduled due to dependency. [ 1257.869444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.888464] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1258.888899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.414868] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1260.415424] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1261.949577] env[71140]: INFO networking_nsxv3.common.synchronization [req-50b2fd2f-5865-4280-ae76-ff988b07cca9 req-6605fa5a-5a54-4629-8d82-79a7fe0d16c0 tempest-ServersNegativeTestJSON-651441888 tempest-ServersNegativeTestJSON-651441888-project-member] Enqueued Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_members [ 1261.950184] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGHEST for action security_group_members [ 1261.950932] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.950932] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.950932] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.951540] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.952610] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.952610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.952610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.952610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.952610] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.952610] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.455254] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.455451] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.455495] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.455784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.455914] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.456019] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.456117] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.456181] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.456819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.456819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.456819] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 is going to be updated. [ 1262.483187] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.483318] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.483535] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.483649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.483738] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.493152] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: IN_PROGRESS for 2s [ 1264.337159] env[71140]: INFO networking_nsxv3.common.synchronization [req-2f4cf32a-619b-432c-a400-bbcc56b5fccc req-e3f34213-e6c4-41ed-9f35-42ff4eb563ca tempest-AttachVolumeTestJSON-775620922 tempest-AttachVolumeTestJSON-775620922-project-member] Enqueued Resource ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b with Priority: HIGHEST for action security_group_members [ 1264.337742] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b with Priority: HIGHEST for action security_group_members [ 1264.338521] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-42f38ff1-7afd-4b06-8a81-a4f009035e8b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.338521] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.338521] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.338521] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.338769] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.338858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.338923] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.339125] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.339241] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.339339] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42f38ff1-7afd-4b06-8a81-a4f009035e8b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.503715] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 in Status: SUCCESS [ 1264.504084] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 deletion is rescheduled due to dependency. [ 1264.504410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.538948] env[71140]: INFO networking_nsxv3.common.synchronization [req-2c5d71ef-ab99-432e-b521-33d059f2e279 req-113dad54-ab48-462a-8d59-812cb0bec102 tempest-ServersTestJSON-1092316267 tempest-ServersTestJSON-1092316267-project-member] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1264.540118] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1264.541039] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.541193] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.541264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.541497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.541670] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.541785] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.541852] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.542033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.542112] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.542208] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.841452] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.841674] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.841768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.841980] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.842093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.842291] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.842391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.842463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.842619] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.842723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.842815] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b is going to be updated. [ 1264.869499] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.869676] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.869719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.869924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.870099] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.878008] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b in Status: IN_PROGRESS for 2s [ 1265.045769] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.346135] env[71140]: INFO networking_nsxv3.common.synchronization [None req-fed82b6c-90c6-4881-8e5a-d1637d0b6985 None None] Enqueued Resource ID: 1fe1f1ed-9e5e-4380-bb1a-17305c5d9c8a with Priority: HIGHEST for action port [ 1265.346905] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fe1f1ed-9e5e-4380-bb1a-17305c5d9c8a with Priority: HIGHEST for action port [ 1265.347584] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fe1f1ed-9e5e-4380-bb1a-17305c5d9c8a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.347826] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fe1f1ed-9e5e-4380-bb1a-17305c5d9c8a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.347884] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fe1f1ed-9e5e-4380-bb1a-17305c5d9c8a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.348365] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fe1f1ed-9e5e-4380-bb1a-17305c5d9c8a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.348577] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fe1f1ed-9e5e-4380-bb1a-17305c5d9c8a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.547673] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.852716] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fe1f1ed-9e5e-4380-bb1a-17305c5d9c8a [ 1265.852716] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.852716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.852716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.852716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.852716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.853113] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fe1f1ed-9e5e-4380-bb1a-17305c5d9c8a already deleted. [ 1265.853113] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fe1f1ed-9e5e-4380-bb1a-17305c5d9c8a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.049776] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.049871] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.049906] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.050140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.050248] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.050348] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1266.080305] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.080453] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.080534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.080742] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.080882] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.089434] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1266.584221] env[71140]: INFO networking_nsxv3.common.synchronization [req-e840e4a6-320a-46a6-9fd4-61ee86617b5d req-a90e4f62-a3ab-49f9-ab51-71dfe21a898a tempest-AttachVolumeShelveTestJSON-926657130 tempest-AttachVolumeShelveTestJSON-926657130-project-member] Enqueued Resource ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 with Priority: HIGHEST for action security_group_members [ 1266.584221] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 with Priority: HIGHEST for action security_group_members [ 1266.584221] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.584221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.584221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.584221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.584221] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.584221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.584766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.584766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.584917] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.584972] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f4aefa9-35c0-4c8a-bade-f3a9b8c62528',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.887337] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b in Status: SUCCESS [ 1266.887523] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b deletion is rescheduled due to dependency. [ 1266.887689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.092735] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.092989] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.096302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.096302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.096302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.096302] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.096302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.096302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.096302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.096302] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.096302] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 is going to be updated. [ 1267.123937] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.124170] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.124170] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.124856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.124856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.132974] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 in Status: IN_PROGRESS for 2s [ 1267.495150] env[71140]: INFO networking_nsxv3.common.synchronization [None req-90bd6a54-0e36-4617-a93e-340014f7fdf4 None None] Enqueued Resource ID: 6e995107-e79f-46d0-b029-e39dece2342b with Priority: HIGHEST for action port [ 1267.495882] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e995107-e79f-46d0-b029-e39dece2342b with Priority: HIGHEST for action port [ 1267.495882] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e995107-e79f-46d0-b029-e39dece2342b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.496044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e995107-e79f-46d0-b029-e39dece2342b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.496081] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e995107-e79f-46d0-b029-e39dece2342b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.496323] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e995107-e79f-46d0-b029-e39dece2342b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.496397] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e995107-e79f-46d0-b029-e39dece2342b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.998035] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e995107-e79f-46d0-b029-e39dece2342b [ 1267.998497] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.998497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.998497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.998791] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.998791] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.998918] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e995107-e79f-46d0-b029-e39dece2342b already deleted. [ 1267.998972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e995107-e79f-46d0-b029-e39dece2342b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.098590] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 4s [ 1269.142351] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 in Status: SUCCESS [ 1269.142704] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f4aefa9-35c0-4c8a-bade-f3a9b8c62528 deletion is rescheduled due to dependency. [ 1269.142704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f4aefa9-35c0-4c8a-bade-f3a9b8c62528" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.108858] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1270.109051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.496991] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1272.497478] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1274.438549] env[71140]: INFO networking_nsxv3.common.synchronization [req-fb6c0742-d75e-477d-b846-d581a76183c7 req-22225b08-2713-4064-87bc-bb8ebba4c797 tempest-ServerRescueTestJSON-1273014346 tempest-ServerRescueTestJSON-1273014346-project-member] Enqueued Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGHEST for action security_group_members [ 1274.439200] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGHEST for action security_group_members [ 1274.439511] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.439629] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.439689] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.439967] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.440152] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.440262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.440324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.440468] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.440551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.440643] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.713080] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.713295] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-357" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.713433] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-357" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.713804] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-357" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.714109] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.714281] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.714403] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.714629] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.714793] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.715045] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1274.715309] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1274.715309] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1274.715482] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1274.715613] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1274.715727] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1274.716100] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1274.735248] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1274.735420] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1274.735560] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1274.735734] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-357" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.736036] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-0f973ac1-3f89-451e-99b2-ccf98e4d019e taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.736209] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-0f973ac1-3f89-451e-99b2-ccf98e4d019e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.736333] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-0f973ac1-3f89-451e-99b2-ccf98e4d019e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.736632] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-0f973ac1-3f89-451e-99b2-ccf98e4d019e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.736774] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f973ac1-3f89-451e-99b2-ccf98e4d019e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.942867] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.943108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.943108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.943319] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.943413] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.943612] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.943713] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.943768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.943918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.943993] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.944278] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 already deleted. [ 1274.944278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.185252] env[71140]: INFO networking_nsxv3.common.synchronization [req-0c4ae2ba-dcfe-4c2f-983a-fb52229c4372 req-4a051977-5c38-418b-9ded-be0d718f1043 tempest-ServersTestJSON-1092316267 tempest-ServersTestJSON-1092316267-project-member] Enqueued Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1275.185511] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8717ad-052a-4a86-b223-df55dd81c619 with Priority: HIGHEST for action security_group_members [ 1275.185834] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e8717ad-052a-4a86-b223-df55dd81c619 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.185951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.186026] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.186221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.186650] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.186650] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.186650] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.186806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.186806] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.186868] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e8717ad-052a-4a86-b223-df55dd81c619',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.238586] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.238816] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.238949] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.239295] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.239481] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.239607] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 0f973ac1-3f89-451e-99b2-ccf98e4d019e not found, creating... [ 1275.239872] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.240044] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.240228] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.240386] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.240526] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.240813] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.240969] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.241105] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.241657] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.241657] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.241657] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 0f973ac1-3f89-451e-99b2-ccf98e4d019e is going to be created. [ 1275.262904] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.263151] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.263284] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.263541] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.263944] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.264609] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-0f973ac1-3f89-451e-99b2-ccf98e4d019e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.690185] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.690618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.690618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.690715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.690756] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.690989] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.691137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.691191] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.691356] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.691455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.691549] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 is going to be updated. [ 1275.718046] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.718204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.718277] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.718552] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.718709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.728495] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: IN_PROGRESS for 2s [ 1275.969752] env[71140]: INFO networking_nsxv3.common.synchronization [req-fb6c0742-d75e-477d-b846-d581a76183c7 req-4ea6dc46-2994-44d4-b064-749e374b2a52 service nova] Enqueued Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGHEST for action security_group_rules [ 1275.969895] env[71140]: INFO networking_nsxv3.common.synchronization [req-fb6c0742-d75e-477d-b846-d581a76183c7 req-4ea6dc46-2994-44d4-b064-749e374b2a52 service nova] Enqueued Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGHEST for action security_group_members [ 1275.970096] env[71140]: INFO networking_nsxv3.common.synchronization [req-fb6c0742-d75e-477d-b846-d581a76183c7 req-4ea6dc46-2994-44d4-b064-749e374b2a52 service nova] Enqueued Resource ID: 0f973ac1-3f89-451e-99b2-ccf98e4d019e with Priority: HIGHEST for action port [ 1275.970336] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGHEST for action security_group_rules [ 1275.970463] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGHEST for action security_group_members [ 1275.970560] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f973ac1-3f89-451e-99b2-ccf98e4d019e with Priority: HIGHEST for action port [ 1275.971377] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2e452e0-733f-44f4-b3cf-d0bcb82432a8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.971579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.971723] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.972059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.972197] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.973121] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.973297] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.973408] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.973633] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.973826] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.973971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.974109] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.974294] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.974423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.974547] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.975636] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f973ac1-3f89-451e-99b2-ccf98e4d019e taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.975803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f973ac1-3f89-451e-99b2-ccf98e4d019e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.975909] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f973ac1-3f89-451e-99b2-ccf98e4d019e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.976108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f973ac1-3f89-451e-99b2-ccf98e4d019e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.976230] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f973ac1-3f89-451e-99b2-ccf98e4d019e',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.481658] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.481658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.481658] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.481658] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f973ac1-3f89-451e-99b2-ccf98e4d019e with status ACTIVE [ 1276.481658] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.481658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.481658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.481658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.481658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.481658] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.481658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.481658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.481658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.481658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.487868] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.487868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.487868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.487868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.487868] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.487868] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f973ac1-3f89-451e-99b2-ccf98e4d019e is going to be updated. [ 1276.504449] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.505027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.505027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.505027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.505027] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.505204] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f973ac1-3f89-451e-99b2-ccf98e4d019e" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.985729] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.487967] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.488187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.488187] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.488405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.488494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.488592] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 is going to be created. [ 1277.511645] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.511857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.511999] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.512226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.512389] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.521544] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 in Status: UNINITIALIZED for 2s [ 1277.738918] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e8717ad-052a-4a86-b223-df55dd81c619 in Status: SUCCESS [ 1277.739132] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e8717ad-052a-4a86-b223-df55dd81c619 deletion is rescheduled due to dependency. [ 1277.739227] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e8717ad-052a-4a86-b223-df55dd81c619" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.530663] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 in Status: SUCCESS [ 1279.530979] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.531091] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.531301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.531490] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.531600] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.531658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.531870] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.531968] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.532077] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.532258] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.034514] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.034668] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.035193] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.035193] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.035193] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.035410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.035410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.035410] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.035534] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.035582] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.035721] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.035807] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.035862] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.035997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.036138] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.036248] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.036308] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.036441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.036510] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.036586] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.036672] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.540886] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2e452e0-733f-44f4-b3cf-d0bcb82432a8: rpc.has_security_group_logging(os_id): False [ 1280.558285] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.558444] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.558518] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.558727] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.558818] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.559022] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.559116] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.559178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.559325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.559402] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.559666] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.559768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.559768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.559899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.559945] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.560151] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.560235] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.560300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.560435] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.560509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.560595] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 is going to be created. [ 1280.614240] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.614240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.614240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.614240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.614240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.622822] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 in Status: IN_PROGRESS for 2s [ 1280.971179] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1280.971299] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1281.381546] env[71140]: INFO networking_nsxv3.common.synchronization [req-4a1f12fb-9ff8-4544-aaf3-d06db1d9d899 req-27d0d4ca-17e5-4bc5-ab85-c32d140a9915 tempest-ServerActionsTestOtherA-289074452 tempest-ServerActionsTestOtherA-289074452-project-member] Enqueued Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_members [ 1281.382110] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_members [ 1281.382415] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-893ec538-5364-452f-9431-cbce81e1231d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.382537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.382604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.384185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.384185] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.384185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.384185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.384185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.384185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.384185] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.886397] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.977824] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-53 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.977916] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.978011] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.978305] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.978594] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.978761] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.978887] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.979439] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.979674] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.979951] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1281.980146] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1281.980318] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1281.980482] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1281.980648] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1281.980807] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1281.980998] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1281.998331] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1281.998497] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1281.998694] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1281.998938] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-53" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.999342] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-4934503c-f795-4eeb-b380-9dfed8f95c6c taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.999588] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-4934503c-f795-4eeb-b380-9dfed8f95c6c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.999782] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-4934503c-f795-4eeb-b380-9dfed8f95c6c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.000189] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-4934503c-f795-4eeb-b380-9dfed8f95c6c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.000400] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4934503c-f795-4eeb-b380-9dfed8f95c6c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.390236] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.503182] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.503429] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.503572] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.503893] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.504085] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.504259] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 4934503c-f795-4eeb-b380-9dfed8f95c6c not found, creating... [ 1282.504546] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.504727] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.504867] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.505127] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.505285] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.505598] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.505770] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.505907] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.506161] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.506399] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.506548] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 4934503c-f795-4eeb-b380-9dfed8f95c6c is going to be created. [ 1282.528027] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.528027] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.528027] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.528027] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.528027] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.528027] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-4934503c-f795-4eeb-b380-9dfed8f95c6c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.639398] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 in Status: SUCCESS [ 1282.639398] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.894501] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.894824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.894824] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.894945] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.895055] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.895160] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 893ec538-5364-452f-9431-cbce81e1231d is going to be updated. [ 1282.921708] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.921874] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.921975] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.922206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.922349] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.932367] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 893ec538-5364-452f-9431-cbce81e1231d in Status: IN_PROGRESS for 2s [ 1283.442744] env[71140]: INFO networking_nsxv3.common.synchronization [req-4a1f12fb-9ff8-4544-aaf3-d06db1d9d899 req-f9f6e1e8-bb85-4dc0-b15d-e584136b0a4e service nova] Enqueued Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_rules [ 1283.443023] env[71140]: INFO networking_nsxv3.common.synchronization [req-4a1f12fb-9ff8-4544-aaf3-d06db1d9d899 req-f9f6e1e8-bb85-4dc0-b15d-e584136b0a4e service nova] Enqueued Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_members [ 1283.443210] env[71140]: INFO networking_nsxv3.common.synchronization [req-4a1f12fb-9ff8-4544-aaf3-d06db1d9d899 req-f9f6e1e8-bb85-4dc0-b15d-e584136b0a4e service nova] Enqueued Resource ID: 4934503c-f795-4eeb-b380-9dfed8f95c6c with Priority: HIGHEST for action port [ 1283.443436] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_rules [ 1283.443564] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_members [ 1283.443658] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4934503c-f795-4eeb-b380-9dfed8f95c6c with Priority: HIGHEST for action port [ 1283.444291] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-893ec538-5364-452f-9431-cbce81e1231d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.444291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.444463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.444564] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.444729] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.445525] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-893ec538-5364-452f-9431-cbce81e1231d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.445654] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.445818] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-4934503c-f795-4eeb-b380-9dfed8f95c6c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.446907] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4934503c-f795-4eeb-b380-9dfed8f95c6c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.446907] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4934503c-f795-4eeb-b380-9dfed8f95c6c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.446907] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4934503c-f795-4eeb-b380-9dfed8f95c6c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.446907] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4934503c-f795-4eeb-b380-9dfed8f95c6c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.948907] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-893ec538-5364-452f-9431-cbce81e1231d taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.951798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.951798] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4934503c-f795-4eeb-b380-9dfed8f95c6c with status ACTIVE [ 1283.951798] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.951798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.951798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.951798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.951798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.951798] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.951798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.951798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.951798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.951798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.951798] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.951798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.951798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.952650] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.952650] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.952650] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4934503c-f795-4eeb-b380-9dfed8f95c6c is going to be updated. [ 1283.970472] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.970624] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.970695] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.970889] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.971040] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.971209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4934503c-f795-4eeb-b380-9dfed8f95c6c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.941833] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 893ec538-5364-452f-9431-cbce81e1231d in Status: SUCCESS [ 1284.942051] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.942214] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.942420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.942605] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.942720] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.942786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.942946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.943042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.943137] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.445579] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.948259] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.450577] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.450971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.450971] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.451186] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.451291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.451374] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 893ec538-5364-452f-9431-cbce81e1231d is going to be updated. [ 1286.476657] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.476959] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.476959] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.477198] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.477388] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.485895] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 893ec538-5364-452f-9431-cbce81e1231d in Status: IN_PROGRESS for 2s [ 1288.444448] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1288.444821] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1288.496576] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 893ec538-5364-452f-9431-cbce81e1231d in Status: SUCCESS [ 1288.496798] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.496962] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.497193] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.497386] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.497498] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.497562] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.497709] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.497787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.497872] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.497961] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.999809] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.502448] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 893ec538-5364-452f-9431-cbce81e1231d: rpc.has_security_group_logging(os_id): False [ 1289.521104] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.521397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.521397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.521531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.541008] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.541313] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.541429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.541496] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.541685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.541767] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.541859] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 893ec538-5364-452f-9431-cbce81e1231d is going to be updated. [ 1289.630222] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.630420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.630420] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.630946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.630946] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.644764] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 893ec538-5364-452f-9431-cbce81e1231d in Status: IN_PROGRESS for 2s [ 1291.664577] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 893ec538-5364-452f-9431-cbce81e1231d in Status: SUCCESS [ 1291.664577] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.446768] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1293.447278] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1298.448320] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1298.448645] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1299.197584] env[71140]: INFO networking_nsxv3.common.synchronization [req-1ed935a8-ddc2-4de4-9b41-212646904846 req-a8a28f64-da0f-4e27-ad5d-92b0727a643d tempest-ServerRescueTestJSON-1273014346 tempest-ServerRescueTestJSON-1273014346-project-member] Enqueued Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGHEST for action security_group_members [ 1299.198478] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGHEST for action security_group_members [ 1299.198478] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.198631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.198631] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.198746] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.198888] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.198985] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.199060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.199210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.199306] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.199398] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.472680] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.473125] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-357" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.473125] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-357" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.473418] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-357" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.473705] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.473875] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.474009] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.474286] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.474448] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.474664] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1299.474823] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1299.474960] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1299.475116] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1299.475275] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1299.475407] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1299.475559] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1299.496978] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1299.496978] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1299.496978] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1299.496978] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-357" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.497330] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-9b54e9be-2175-47d3-bf11-19e0b55457df taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.497411] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-9b54e9be-2175-47d3-bf11-19e0b55457df" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.497587] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-9b54e9be-2175-47d3-bf11-19e0b55457df" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.497845] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-9b54e9be-2175-47d3-bf11-19e0b55457df" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.498080] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b54e9be-2175-47d3-bf11-19e0b55457df',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.701834] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.000328] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.000624] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.000954] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.001100] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.001220] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.001388] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 9b54e9be-2175-47d3-bf11-19e0b55457df not found, creating... [ 1300.001786] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.001943] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.002196] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.002323] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.002474] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.002766] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.002927] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.003317] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.003587] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.003738] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.003889] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 9b54e9be-2175-47d3-bf11-19e0b55457df is going to be created. [ 1300.023079] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.023314] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.023433] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.023680] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.023907] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.024269] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-9b54e9be-2175-47d3-bf11-19e0b55457df" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.038154] env[71140]: INFO networking_nsxv3.common.synchronization [req-865ea7dc-b1cd-4024-947f-ce3c88267b48 req-7aca28f9-ac3b-4d8a-8590-ec430f93526b tempest-ServerActionsV293TestJSON-699960627 tempest-ServerActionsV293TestJSON-699960627-project-member] Enqueued Resource ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a with Priority: HIGHEST for action security_group_members [ 1300.038727] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a with Priority: HIGHEST for action security_group_members [ 1300.039035] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-933bc47a-63e8-4a49-aa3e-e491140ef01a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.039164] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.039226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.039411] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.039563] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.040536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.040536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.040536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.040536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.040794] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933bc47a-63e8-4a49-aa3e-e491140ef01a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.203973] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.542425] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.542737] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.542737] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.542876] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.542968] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.543154] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.543271] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.543311] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.543455] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.543522] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.543611] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a is going to be updated. [ 1300.569668] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.569808] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.569864] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.570195] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.570338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.578200] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a in Status: IN_PROGRESS for 2s [ 1300.706451] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.706557] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.706920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.706920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.707094] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.707136] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 is going to be updated. [ 1300.735059] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.735059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.735059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.735059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.735059] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.741124] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 in Status: IN_PROGRESS for 2s [ 1300.774814] env[71140]: INFO networking_nsxv3.common.synchronization [req-1ed935a8-ddc2-4de4-9b41-212646904846 req-2cab1bfa-7bca-402a-b18d-35daa3644bea service nova] Enqueued Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGHEST for action security_group_rules [ 1300.775061] env[71140]: INFO networking_nsxv3.common.synchronization [req-1ed935a8-ddc2-4de4-9b41-212646904846 req-2cab1bfa-7bca-402a-b18d-35daa3644bea service nova] Enqueued Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGHEST for action security_group_members [ 1300.775283] env[71140]: INFO networking_nsxv3.common.synchronization [req-1ed935a8-ddc2-4de4-9b41-212646904846 req-2cab1bfa-7bca-402a-b18d-35daa3644bea service nova] Enqueued Resource ID: 9b54e9be-2175-47d3-bf11-19e0b55457df with Priority: HIGHEST for action port [ 1300.775526] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGHEST for action security_group_rules [ 1300.775660] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGHEST for action security_group_members [ 1300.775808] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b54e9be-2175-47d3-bf11-19e0b55457df with Priority: HIGHEST for action port [ 1300.776304] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2e452e0-733f-44f4-b3cf-d0bcb82432a8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.776433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.776517] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.776690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.776804] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.779859] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.779859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.779859] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b54e9be-2175-47d3-bf11-19e0b55457df taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.779859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b54e9be-2175-47d3-bf11-19e0b55457df" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.779859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b54e9be-2175-47d3-bf11-19e0b55457df" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.779859] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b54e9be-2175-47d3-bf11-19e0b55457df" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.779859] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b54e9be-2175-47d3-bf11-19e0b55457df',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.280041] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.280329] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.280329] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b54e9be-2175-47d3-bf11-19e0b55457df with status ACTIVE [ 1301.280541] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.280662] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.280662] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.280845] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.280927] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.281881] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.281881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.281881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.281881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.281881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.281881] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.281881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.281881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.281881] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.282338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.282338] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b54e9be-2175-47d3-bf11-19e0b55457df is going to be updated. [ 1301.302606] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.302762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.302762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.302961] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.303154] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.303338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b54e9be-2175-47d3-bf11-19e0b55457df" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.664484] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a in Status: SUCCESS [ 1302.664484] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933bc47a-63e8-4a49-aa3e-e491140ef01a deletion is rescheduled due to dependency. [ 1302.664484] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933bc47a-63e8-4a49-aa3e-e491140ef01a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.750597] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 in Status: SUCCESS [ 1302.750863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.751252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.751506] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.751714] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.751854] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.751931] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.752292] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.752382] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.752492] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.255012] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.757999] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.816537] env[71140]: INFO networking_nsxv3.common.synchronization [None req-bb25aa52-dc63-49ef-9121-b011b643c897 None None] Enqueued Resource ID: ba5676c8-6895-4169-8a24-1bc4890b6985 with Priority: HIGHEST for action port [ 1303.816853] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba5676c8-6895-4169-8a24-1bc4890b6985 with Priority: HIGHEST for action port [ 1303.817561] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba5676c8-6895-4169-8a24-1bc4890b6985 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.817628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba5676c8-6895-4169-8a24-1bc4890b6985" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.817670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba5676c8-6895-4169-8a24-1bc4890b6985" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.817979] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba5676c8-6895-4169-8a24-1bc4890b6985" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.817979] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba5676c8-6895-4169-8a24-1bc4890b6985',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.262039] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.262039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.262039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.262039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.262039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.262039] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 is going to be updated. [ 1304.292264] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.292264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.292752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.292752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.292752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.300573] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 in Status: IN_PROGRESS for 2s [ 1304.320137] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba5676c8-6895-4169-8a24-1bc4890b6985 [ 1304.320282] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.320398] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.320464] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.320669] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.320759] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.320850] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba5676c8-6895-4169-8a24-1bc4890b6985 already deleted. [ 1304.320932] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba5676c8-6895-4169-8a24-1bc4890b6985" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.981204] env[71140]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1304.981503] env[71140]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-dcbf910a-06a3-4925-9bcc-f7a9e0eda6cd None None] NSXv3 Agent Agent loop - iteration:3 started [ 1305.723843] env[71140]: INFO networking_nsxv3.common.synchronization [None req-416d7f55-fbd9-4156-b21f-c022b673f9f7 None None] Enqueued Resource ID: 672e37c4-ce3c-42d5-a9f7-fab8726fde01 with Priority: HIGHEST for action port [ 1305.724085] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 672e37c4-ce3c-42d5-a9f7-fab8726fde01 with Priority: HIGHEST for action port [ 1305.724919] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-672e37c4-ce3c-42d5-a9f7-fab8726fde01 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.724919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-672e37c4-ce3c-42d5-a9f7-fab8726fde01" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.724919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-672e37c4-ce3c-42d5-a9f7-fab8726fde01" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.725251] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-672e37c4-ce3c-42d5-a9f7-fab8726fde01" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.725362] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('672e37c4-ce3c-42d5-a9f7-fab8726fde01',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.226916] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 672e37c4-ce3c-42d5-a9f7-fab8726fde01 [ 1306.227195] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.227319] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.227383] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.227593] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.227682] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.227777] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:672e37c4-ce3c-42d5-a9f7-fab8726fde01 already deleted. [ 1306.227858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-672e37c4-ce3c-42d5-a9f7-fab8726fde01" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.313282] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 in Status: SUCCESS [ 1306.313490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.313650] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.313863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.314066] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.314186] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.314252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.314416] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.314514] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.314604] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.314696] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.817363] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.817537] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.817621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.817836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.818009] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.818120] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.818196] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.818349] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.818440] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.818708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.818889] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.818995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.819074] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.819234] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.819382] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.819506] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.819585] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.819730] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.819823] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.819883] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.819975] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.322288] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2e452e0-733f-44f4-b3cf-d0bcb82432a8: rpc.has_security_group_logging(os_id): False [ 1307.339226] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.339423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.339423] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.339628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.339721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.339910] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.340019] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.340118] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.340240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.340316] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.340512] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.340603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.340667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.340805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.340878] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.341079] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.341174] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.341236] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.341374] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.341446] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.341530] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 is going to be updated. [ 1307.396636] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.396792] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.396854] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.397069] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.397217] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.408630] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 in Status: IN_PROGRESS for 2s [ 1309.284749] env[71140]: INFO networking_nsxv3.common.synchronization [req-8047a5f7-c529-4b50-bafd-411cff53783b req-344e9f86-7af4-498c-9790-a572f6a2d134 tempest-ServerPasswordTestJSON-477002315 tempest-ServerPasswordTestJSON-477002315-project-member] Enqueued Resource ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 with Priority: HIGHEST for action security_group_members [ 1309.285294] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 with Priority: HIGHEST for action security_group_members [ 1309.285596] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aa19c80-0774-4c48-82b1-3685da8fb1c4 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.285718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.285780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.286090] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.286281] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.286441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.286441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.286621] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.286693] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.286790] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aa19c80-0774-4c48-82b1-3685da8fb1c4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.423496] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 in Status: SUCCESS [ 1309.423697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.538981] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-722 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.539215] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-722" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.539355] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-722" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.539705] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-722" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.539997] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.540836] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.541341] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.541341] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.541489] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.541599] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1309.541717] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1309.541831] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1309.541944] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1309.542069] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1309.542232] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1309.542384] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1309.580033] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1309.580033] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1309.580240] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1309.580240] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-722" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.580554] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-7b556e66-ce9a-488f-97d1-8f6f3c053010 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.580732] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-7b556e66-ce9a-488f-97d1-8f6f3c053010" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.580890] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-7b556e66-ce9a-488f-97d1-8f6f3c053010" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.581325] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-7b556e66-ce9a-488f-97d1-8f6f3c053010" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.581482] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b556e66-ce9a-488f-97d1-8f6f3c053010',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.788561] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.788775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.788871] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.789143] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.789260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.789500] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.789618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.789703] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.789891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.790086] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.790328] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 already deleted. [ 1309.790441] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.084372] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.084682] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.084854] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.085160] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.085358] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.085542] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 7b556e66-ce9a-488f-97d1-8f6f3c053010 not found, creating... [ 1310.085831] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.086017] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.086169] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.086418] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.086575] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.086882] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.087063] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.087204] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.087531] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.087686] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.087852] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 7b556e66-ce9a-488f-97d1-8f6f3c053010 is going to be created. [ 1310.109916] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.110159] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.110297] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.110564] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.110799] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.111686] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-7b556e66-ce9a-488f-97d1-8f6f3c053010" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.763530] env[71140]: INFO networking_nsxv3.common.synchronization [req-8047a5f7-c529-4b50-bafd-411cff53783b req-e5035fe3-a48c-453a-a0de-f496e89af6fa service nova] Enqueued Resource ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 with Priority: HIGHEST for action security_group_rules [ 1310.763530] env[71140]: INFO networking_nsxv3.common.synchronization [req-8047a5f7-c529-4b50-bafd-411cff53783b req-e5035fe3-a48c-453a-a0de-f496e89af6fa service nova] Enqueued Resource ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 with Priority: HIGHEST for action security_group_members [ 1310.763530] env[71140]: INFO networking_nsxv3.common.synchronization [req-8047a5f7-c529-4b50-bafd-411cff53783b req-e5035fe3-a48c-453a-a0de-f496e89af6fa service nova] Enqueued Resource ID: 7b556e66-ce9a-488f-97d1-8f6f3c053010 with Priority: HIGHEST for action port [ 1310.763530] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 with Priority: HIGHEST for action security_group_rules [ 1310.763530] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 with Priority: HIGHEST for action security_group_members [ 1310.763530] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b556e66-ce9a-488f-97d1-8f6f3c053010 with Priority: HIGHEST for action port [ 1310.763530] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aa19c80-0774-4c48-82b1-3685da8fb1c4 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.763530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.763530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.763530] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.764315] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aa19c80-0774-4c48-82b1-3685da8fb1c4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.765617] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aa19c80-0774-4c48-82b1-3685da8fb1c4 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.765617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.765617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.765617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.765854] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.765854] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.765854] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.765974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.766020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.766723] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aa19c80-0774-4c48-82b1-3685da8fb1c4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.768643] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b556e66-ce9a-488f-97d1-8f6f3c053010 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.768643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b556e66-ce9a-488f-97d1-8f6f3c053010" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.768643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b556e66-ce9a-488f-97d1-8f6f3c053010" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.768643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b556e66-ce9a-488f-97d1-8f6f3c053010" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.768643] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b556e66-ce9a-488f-97d1-8f6f3c053010',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.268986] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2aa19c80-0774-4c48-82b1-3685da8fb1c4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.270070] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aa19c80-0774-4c48-82b1-3685da8fb1c4 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.270255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.271827] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b556e66-ce9a-488f-97d1-8f6f3c053010 with status ACTIVE [ 1311.272012] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.272137] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.272262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.272570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.272570] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.272742] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.272818] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.272856] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.273016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.273093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.273361] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.273479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.273549] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.273671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.273745] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.273828] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b556e66-ce9a-488f-97d1-8f6f3c053010 is going to be updated. [ 1311.294752] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.294933] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.294933] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.295107] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.295190] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.295347] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b556e66-ce9a-488f-97d1-8f6f3c053010" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.771744] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2aa19c80-0774-4c48-82b1-3685da8fb1c4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.275141] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.275141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.275141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.275141] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.275351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.275351] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 is going to be created. [ 1312.298066] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.298066] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.298066] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.298066] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.298433] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.307215] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 in Status: UNINITIALIZED for 2s [ 1314.320018] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 in Status: SUCCESS [ 1314.320018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.320018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.320018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.320018] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.320018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.320018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.320018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.320018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.320018] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.320018] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2aa19c80-0774-4c48-82b1-3685da8fb1c4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.823126] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aa19c80-0774-4c48-82b1-3685da8fb1c4 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.823126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.823126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.823126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.823126] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.823126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.823126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.823126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.823715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.823715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.823715] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aa19c80-0774-4c48-82b1-3685da8fb1c4 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.823715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.823715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.823715] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.823941] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.823941] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.823941] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.824062] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.824270] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.824379] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.824519] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2aa19c80-0774-4c48-82b1-3685da8fb1c4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.327032] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2aa19c80-0774-4c48-82b1-3685da8fb1c4: rpc.has_security_group_logging(os_id): False [ 1315.344074] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.344262] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.344345] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.344526] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.344605] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.344800] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.344902] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.344965] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.345140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.345219] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.345650] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.345752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.345815] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.345960] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.346047] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.346239] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.346336] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.346397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.346553] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.346636] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.346723] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 is going to be created. [ 1315.403298] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.403491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.403491] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.403667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.403839] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.413318] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 in Status: IN_PROGRESS for 2s [ 1315.762547] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.762750] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1317.425223] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 in Status: SUCCESS [ 1317.425692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.764083] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1320.764456] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1323.828109] env[71140]: INFO networking_nsxv3.common.synchronization [req-f667ea02-6b65-41b8-96e4-e16662ac0c51 req-366bab42-44ea-42ef-aab4-148f4cad7970 tempest-ServerPasswordTestJSON-477002315 tempest-ServerPasswordTestJSON-477002315-project-member] Enqueued Resource ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 with Priority: HIGHEST for action security_group_members [ 1323.828628] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 with Priority: HIGHEST for action security_group_members [ 1323.828924] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aa19c80-0774-4c48-82b1-3685da8fb1c4 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.829084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.829140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.829337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.829492] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.829590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.829692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.829781] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.829866] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.829954] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aa19c80-0774-4c48-82b1-3685da8fb1c4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.333507] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.333780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.333900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.334225] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.334385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.334699] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.334867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.334982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.335279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.335495] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.335650] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 is going to be updated. [ 1324.363724] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.363937] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.364039] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.364335] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.364542] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.373797] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 in Status: IN_PROGRESS for 2s [ 1326.012427] env[71140]: INFO networking_nsxv3.common.synchronization [req-9e5aca88-b77b-44e9-866a-05497f5d289e req-53532b77-246d-4b4f-8d76-53e2de40cba1 tempest-ServerRescueTestJSON-1273014346 tempest-ServerRescueTestJSON-1273014346-project-member] Enqueued Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGHEST for action security_group_members [ 1326.012427] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGHEST for action security_group_members [ 1326.012427] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.012427] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.012427] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.012427] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.012427] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.012427] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.012427] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.013144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.013355] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.013846] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.287388] env[71140]: INFO networking_nsxv3.common.synchronization [req-70df7359-c620-4ec1-9ceb-8cc5c430bb68 req-28707960-125c-45c7-9f3f-e3f4158bcdff tempest-ServerActionsTestJSON-2079743708 tempest-ServerActionsTestJSON-2079743708-project-member] Enqueued Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 1326.287924] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 1326.288267] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.288417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.288488] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.288787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.288980] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.289161] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.289225] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.289421] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.289509] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.289617] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.384407] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 in Status: SUCCESS [ 1326.384636] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 deletion is rescheduled due to dependency. [ 1326.384753] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.518972] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.791609] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.791836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.791836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.792155] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.792284] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.792554] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.792700] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.792789] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.792978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.793098] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.793207] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 is going to be updated. [ 1326.822808] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.823011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.823011] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.823247] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.823454] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.831654] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: IN_PROGRESS for 2s [ 1327.022194] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.526068] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.526068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.526068] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.526396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.526396] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.526471] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 is going to be updated. [ 1327.554765] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.554891] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.554988] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.555516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.555665] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.564152] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 in Status: IN_PROGRESS for 2s [ 1328.841188] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: SUCCESS [ 1328.841545] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 deletion is rescheduled due to dependency. [ 1328.841545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.573429] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 in Status: SUCCESS [ 1329.573654] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.288455] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1331.288819] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1332.674311] env[71140]: INFO networking_nsxv3.common.synchronization [req-c02bcca4-0250-4d9c-ba34-bcbf17576096 req-23a15122-0aba-43f8-995d-c8566f700adb tempest-ServerRescueTestJSON-1273014346 tempest-ServerRescueTestJSON-1273014346-project-member] Enqueued Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGHEST for action security_group_members [ 1332.674686] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGHEST for action security_group_members [ 1332.674994] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.675140] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.675207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.675406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.675557] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.675652] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.675711] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.675860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.675942] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.676046] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.178241] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.178438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.178438] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.178632] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.178711] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.178908] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.179016] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.179078] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.179231] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.179305] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.179389] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 is going to be updated. [ 1333.207777] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.207927] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.207972] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.208142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.208273] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.215432] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 in Status: IN_PROGRESS for 2s [ 1335.226018] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 in Status: SUCCESS [ 1335.226417] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 deletion is rescheduled due to dependency. [ 1335.226417] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.352628] env[71140]: INFO networking_nsxv3.common.synchronization [req-b6fdc727-7ff3-416f-acd9-dfb106ff7e2b req-49bf92a4-5f88-4eaa-8dd2-45ebf182f36a tempest-ServerActionsTestJSON-2079743708 tempest-ServerActionsTestJSON-2079743708-project-member] Enqueued Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 1336.352628] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 1336.352628] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.352628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.352628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.352628] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.352628] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.353295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.353489] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.353802] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.354772] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.355021] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.860028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.860028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.860028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.860028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.860028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.860028] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.860028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.860028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.860028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.860028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.860028] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 is going to be updated. [ 1336.883625] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.883625] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.883625] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.883625] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.883625] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.891687] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: IN_PROGRESS for 2s [ 1337.341171] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-168 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.341391] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-168" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.341521] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-168" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.341809] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-168" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.342118] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.342283] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.342466] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.342713] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.342868] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.343094] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1337.343213] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1337.343323] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1337.343436] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1337.343549] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1337.343656] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1337.343793] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1337.363271] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1337.363609] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1337.363658] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1337.363818] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-168" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.364131] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-f197ee10-c8f7-40ac-a8fd-0c17dea63cf2 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.364312] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-f197ee10-c8f7-40ac-a8fd-0c17dea63cf2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.364440] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-f197ee10-c8f7-40ac-a8fd-0c17dea63cf2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.364745] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-f197ee10-c8f7-40ac-a8fd-0c17dea63cf2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.364888] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f197ee10-c8f7-40ac-a8fd-0c17dea63cf2',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.867320] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.867538] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.867676] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.867964] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.868547] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.868547] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port f197ee10-c8f7-40ac-a8fd-0c17dea63cf2 not found, creating... [ 1337.868657] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.868816] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.868900] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.869138] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.869285] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.869568] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.869729] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.869849] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.870070] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.870210] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.870353] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: f197ee10-c8f7-40ac-a8fd-0c17dea63cf2 is going to be created. [ 1337.890053] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.890267] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.890387] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.890641] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.890871] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.891108] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-f197ee10-c8f7-40ac-a8fd-0c17dea63cf2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.559694] env[71140]: INFO networking_nsxv3.common.synchronization [req-b6fdc727-7ff3-416f-acd9-dfb106ff7e2b req-43b9477a-1845-4092-a5c5-ddd1b60292b8 service nova] Enqueued Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_rules [ 1338.559956] env[71140]: INFO networking_nsxv3.common.synchronization [req-b6fdc727-7ff3-416f-acd9-dfb106ff7e2b req-43b9477a-1845-4092-a5c5-ddd1b60292b8 service nova] Enqueued Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 1338.560042] env[71140]: INFO networking_nsxv3.common.synchronization [req-b6fdc727-7ff3-416f-acd9-dfb106ff7e2b req-43b9477a-1845-4092-a5c5-ddd1b60292b8 service nova] Enqueued Resource ID: f197ee10-c8f7-40ac-a8fd-0c17dea63cf2 with Priority: HIGHEST for action port [ 1338.560566] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_rules [ 1338.560662] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 1338.560760] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f197ee10-c8f7-40ac-a8fd-0c17dea63cf2 with Priority: HIGHEST for action port [ 1338.561068] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.561193] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.561261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.561463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.561544] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.562429] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.562546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.562702] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-f197ee10-c8f7-40ac-a8fd-0c17dea63cf2 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.562802] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f197ee10-c8f7-40ac-a8fd-0c17dea63cf2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.562932] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f197ee10-c8f7-40ac-a8fd-0c17dea63cf2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.563098] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f197ee10-c8f7-40ac-a8fd-0c17dea63cf2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.563174] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f197ee10-c8f7-40ac-a8fd-0c17dea63cf2',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.900968] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: SUCCESS [ 1338.901169] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 deletion is rescheduled due to dependency. [ 1338.901279] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.901437] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.901667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.901832] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.901938] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.901996] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.902165] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.902249] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.902345] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.065260] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.065437] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.065521] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f197ee10-c8f7-40ac-a8fd-0c17dea63cf2 with status ACTIVE [ 1339.065664] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.067372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.067372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.067372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.067372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.067372] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.067372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.067372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.067372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.067372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.067372] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.067372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.067372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.067372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.067372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.067372] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f197ee10-c8f7-40ac-a8fd-0c17dea63cf2 is going to be updated. [ 1339.086483] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.086483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.086483] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.086719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.086719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.086854] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f197ee10-c8f7-40ac-a8fd-0c17dea63cf2" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.404797] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.906780] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.411077] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.411260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.411260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.411500] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.411613] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.411719] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 is going to be updated. [ 1340.437542] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.437701] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.437762] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.437954] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.438119] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.446052] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: IN_PROGRESS for 2s [ 1342.457052] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: SUCCESS [ 1342.457052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.457052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.457052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.457504] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.457504] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.457504] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.457650] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.457650] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.457732] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.457791] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.959573] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.461399] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e62d50e-c934-4166-825a-6649880de6a7: rpc.has_security_group_logging(os_id): False [ 1343.479580] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.479734] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.479787] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.479995] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.480100] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.480343] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.480445] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.480532] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.480726] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.480809] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.480898] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 is going to be updated. [ 1343.536180] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.536378] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.536431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.536658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.536839] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.549999] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: IN_PROGRESS for 2s [ 1343.561333] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1343.561464] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1345.563351] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: SUCCESS [ 1345.563717] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.927719] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.927719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.927719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.927719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.927719] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.429083] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.931410] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.433625] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1348.433828] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1348.562604] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.562777] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1349.186377] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.186677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.186677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.186819] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.198178] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1349.199031] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.199995] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1349.259416] env[71140]: INFO networking_nsxv3.common.synchronization [req-5104683f-a381-46b0-a122-2f34602808f6 req-3473dd19-c349-4bcc-96b6-f8b47a807982 tempest-ServerActionsTestOtherA-289074452 tempest-ServerActionsTestOtherA-289074452-project-member] Enqueued Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_members [ 1349.259926] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_members [ 1349.260284] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-893ec538-5364-452f-9431-cbce81e1231d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.260432] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.260501] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.260694] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.260856] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.260974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.261045] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.261215] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.261301] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.261391] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.270315] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.270485] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.270533] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.270688] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.283900] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.284710] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1349.284831] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1349.284892] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1349.325853] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.326050] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.326097] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.326269] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.327493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.327655] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1349.404208] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.404434] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.404434] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.404637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.404968] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.405253] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1349.481357] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.481569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.481569] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.481770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.482062] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.482331] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:48. [ 1349.482429] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'42f38ff1-7afd-4b06-8a81-a4f009035e8b', '8c99ec8b-0259-4916-a240-54938fc5a81c', '2aa19c80-0774-4c48-82b1-3685da8fb1c4', '4c549bd3-468a-4655-b709-3480ff374e11', '638f5992-652b-4deb-89c8-b409cb49bf0a', '4fe121ab-f6de-4059-bbdf-9b957346a3d3', '8623c530-dbd9-4cff-983a-f2df2ac9ad58', '84ef6ff9-0b29-4536-8581-a65788a9e9d0', 'a2e452e0-733f-44f4-b3cf-d0bcb82432a8', 'a9372f7d-fcc5-4703-b77d-bbb4d1695328', '43a772d0-e00d-4627-ad2d-c6c3ccbcee06', 'b8bf2e04-ddcc-43f4-b665-59a628a61547', '30d81b57-1e7d-4b6c-8223-18f586dd832a', '89ab7a19-079c-4b53-bee2-637fae5e2fc1', 'e42db4b7-b71b-4297-acb7-b4910e7af664', 'e1516d35-770d-4ac2-bf00-b0eed6f837f7', '4143c3a0-53e5-4025-8a89-c9d1e7dbb668', 'a008c941-3472-43c0-815f-ad4259496329', 'dc7015c2-a058-452d-bfd5-0575d4a237f8', '893ec538-5364-452f-9431-cbce81e1231d', '622a5b07-14ae-44ec-94dd-57b4349034a7', '522bdeb8-3be1-4507-b2cc-adc33ff88371', '8f4aefa9-35c0-4c8a-bade-f3a9b8c62528', '1b5a6141-3574-468b-87ed-785459f7a84a', '66227fe8-4a5f-47ba-add3-defc26d5bd6a', '6e8717ad-052a-4a86-b223-df55dd81c619', '3e62d50e-c934-4166-825a-6649880de6a7', '83375852-3b13-42bc-b95c-09c5949dc69a', '878a96b3-04c2-49e0-a7d2-cbbb47bf5319', 'f9ec394c-128b-4456-9eb1-76442418ea09', '933bc47a-63e8-4a49-aa3e-e491140ef01a', 'bc92ef18-2831-4b38-acbe-82e66080661f', 'c62a92b8-4863-4e9d-809d-e8687b429f2a', '2548cfa1-8571-4be8-becb-2b5d950d7202', 'a482dc33-1078-4fb7-8fcb-21990f415f82', 'e12e6f08-d99f-4fd3-9323-d04895bd2256', '6cb57d72-3644-432b-8c2c-9a03c173956e', 'dea05fd0-2f31-49b2-a904-3b840403e3a7', '9a300b78-a05e-47a1-bd01-b7e39a483342', '083af43f-5ab0-4b05-a7bb-d6121e5f0390', '604d5290-2f79-4d99-b6f1-1e0335d615a9', '54bba0b8-b95d-4902-8afe-f2600efb516b', 'f3e5dc50-8f82-494d-8a76-86f2e68a6f6a', 'a6eb3617-ce46-425c-b053-a5240fa9c14e', 'b2ad47d5-b746-415d-9e5e-05d9539a1fb9', 'd7d76214-330f-43f9-a3bd-c36a084b6ab5', 'e010a3d8-12ba-4790-bd4e-82c0e5662a99', '40b2250b-502e-4365-a6ba-2ea8c2fa6c5e'} {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1349.482626] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1349.518235] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.518463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.518463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.518614] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.518697] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.518800] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1349.518876] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1349.518933] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1349.630660] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.630924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.630924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.631122] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.632261] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.632571] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1349.632656] env[71140]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=71140) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1349.632733] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1349.632796] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1349.632874] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/48 resources of Type:Security Group Rules [ 1349.632947] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b with Priority: HIGH for action security_group_rules [ 1349.633039] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGH for action security_group_rules [ 1349.633102] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 with Priority: HIGH for action security_group_rules [ 1349.633162] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGH for action security_group_rules [ 1349.633215] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 638f5992-652b-4deb-89c8-b409cb49bf0a with Priority: HIGH for action security_group_rules [ 1349.633274] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 with Priority: HIGH for action security_group_rules [ 1349.633329] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 with Priority: HIGH for action security_group_rules [ 1349.633381] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 with Priority: HIGH for action security_group_rules [ 1349.633441] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGH for action security_group_rules [ 1349.633515] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 with Priority: HIGH for action security_group_rules [ 1349.633588] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGH for action security_group_rules [ 1349.633662] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGH for action security_group_rules [ 1349.633726] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGH for action security_group_rules [ 1349.633775] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 with Priority: HIGH for action security_group_rules [ 1349.633830] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e42db4b7-b71b-4297-acb7-b4910e7af664 with Priority: HIGH for action security_group_rules [ 1349.633890] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 with Priority: HIGH for action security_group_rules [ 1349.633938] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 with Priority: HIGH for action security_group_rules [ 1349.633986] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a008c941-3472-43c0-815f-ad4259496329 with Priority: HIGH for action security_group_rules [ 1349.634067] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGH for action security_group_rules [ 1349.634119] env[71140]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGH for action security_group_rules [ 1349.634207] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.763401] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.277752] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.780086] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.780354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.780354] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.780551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.780652] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.780768] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 893ec538-5364-452f-9431-cbce81e1231d is going to be updated. [ 1350.806585] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.806771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.806863] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.806980] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.807465] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.815326] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 893ec538-5364-452f-9431-cbce81e1231d in Status: IN_PROGRESS for 2s [ 1352.826411] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 893ec538-5364-452f-9431-cbce81e1231d in Status: SUCCESS [ 1352.826801] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.261405] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1354.261776] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1354.261776] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b with Priority: HIGH for action security_group_rules [ 1354.261776] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 with Priority: HIGH for action security_group_rules [ 1354.261776] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 with Priority: HIGH for action security_group_rules [ 1354.261928] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42db4b7-b71b-4297-acb7-b4910e7af664 with Priority: HIGH for action security_group_rules [ 1354.261963] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGH for action security_group_rules [ 1354.262094] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 with Priority: HIGH for action security_group_rules [ 1354.262165] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a008c941-3472-43c0-815f-ad4259496329 with Priority: HIGH for action security_group_rules [ 1354.262252] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 with Priority: HIGH for action security_group_rules [ 1354.262341] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 with Priority: HIGH for action security_group_rules [ 1354.262456] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 with Priority: HIGH for action security_group_rules [ 1354.262534] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a with Priority: HIGH for action security_group_rules [ 1354.262630] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 with Priority: HIGH for action security_group_rules [ 1354.262706] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 with Priority: HIGH for action security_group_rules [ 1354.262791] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 with Priority: HIGH for action security_group_rules [ 1354.262877] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 with Priority: HIGH for action security_group_rules [ 1354.262960] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 with Priority: HIGH for action security_group_rules [ 1354.263054] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 with Priority: HIGH for action security_group_rules [ 1354.263139] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638f5992-652b-4deb-89c8-b409cb49bf0a with Priority: HIGH for action security_group_rules [ 1354.263232] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c99ec8b-0259-4916-a240-54938fc5a81c with Priority: HIGH for action security_group_rules [ 1354.263317] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c549bd3-468a-4655-b709-3480ff374e11 with Priority: HIGH for action security_group_rules [ 1354.263690] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.263843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.263911] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.264215] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.264313] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42f38ff1-7afd-4b06-8a81-a4f009035e8b',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.265302] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aa19c80-0774-4c48-82b1-3685da8fb1c4 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.265452] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.265543] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.265712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.265788] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aa19c80-0774-4c48-82b1-3685da8fb1c4',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.267192] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.267192] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.267192] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.267192] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.267499] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8623c530-dbd9-4cff-983a-f2df2ac9ad58',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.267882] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e42db4b7-b71b-4297-acb7-b4910e7af664 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.267993] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.268076] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.268226] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.268298] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e42db4b7-b71b-4297-acb7-b4910e7af664',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.269052] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-893ec538-5364-452f-9431-cbce81e1231d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.269178] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.269244] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.269418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.269491] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.270170] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc7015c2-a058-452d-bfd5-0575d4a237f8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.270281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.270335] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.270766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.270766] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc7015c2-a058-452d-bfd5-0575d4a237f8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.271326] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a008c941-3472-43c0-815f-ad4259496329 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.271432] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.271501] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.271646] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.271737] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a008c941-3472-43c0-815f-ad4259496329',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.272437] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4143c3a0-53e5-4025-8a89-c9d1e7dbb668 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.272645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.272645] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.272769] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.272831] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4143c3a0-53e5-4025-8a89-c9d1e7dbb668',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.273487] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89ab7a19-079c-4b53-bee2-637fae5e2fc1 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.273618] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.273710] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.273821] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.273919] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89ab7a19-079c-4b53-bee2-637fae5e2fc1',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.274746] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.274896] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.275253] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.275253] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.275253] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1516d35-770d-4ac2-bf00-b0eed6f837f7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.275848] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30d81b57-1e7d-4b6c-8223-18f586dd832a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.275955] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.276017] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.276168] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.276235] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30d81b57-1e7d-4b6c-8223-18f586dd832a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.276884] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8bf2e04-ddcc-43f4-b665-59a628a61547 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.276989] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.277080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.277210] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.277276] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8bf2e04-ddcc-43f4-b665-59a628a61547',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.277943] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.278058] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.278126] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.278265] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.278331] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43a772d0-e00d-4627-ad2d-c6c3ccbcee06',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.280522] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.280649] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.280724] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.280896] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.281007] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9372f7d-fcc5-4703-b77d-bbb4d1695328',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.281666] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2e452e0-733f-44f4-b3cf-d0bcb82432a8 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.281777] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.281836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.282042] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.282253] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2e452e0-733f-44f4-b3cf-d0bcb82432a8',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.282968] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.283082] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.283136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.283291] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.283365] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fe121ab-f6de-4059-bbdf-9b957346a3d3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.284055] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.284176] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.284260] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.284387] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.284493] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84ef6ff9-0b29-4536-8581-a65788a9e9d0',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.285290] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-638f5992-652b-4deb-89c8-b409cb49bf0a taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.285405] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.285490] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.285617] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.285735] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('638f5992-652b-4deb-89c8-b409cb49bf0a',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.286346] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c99ec8b-0259-4916-a240-54938fc5a81c taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.286451] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.286516] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.286670] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.286784] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c99ec8b-0259-4916-a240-54938fc5a81c',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.287412] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c549bd3-468a-4655-b709-3480ff374e11 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.287520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.287587] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.287729] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.287806] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c549bd3-468a-4655-b709-3480ff374e11',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.314498] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.314657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.314740] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.314851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.319218] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.319337] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.338080] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.338194] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2e452e0-733f-44f4-b3cf-d0bcb82432a8 is going to be deleted. [ 1354.339185] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.339368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.381418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.381537] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42db4b7-b71b-4297-acb7-b4910e7af664 is going to be deleted. [ 1354.445596] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.445836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.445836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.446028] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.446129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.446253] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2e452e0-733f-44f4-b3cf-d0bcb82432a8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.454875] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.455047] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.455089] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.455263] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.455350] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.455480] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e42db4b7-b71b-4297-acb7-b4910e7af664" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.796719] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-893ec538-5364-452f-9431-cbce81e1231d taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.796719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.796719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.796719] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.796719] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.797134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.797134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.797134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.797134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.797134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.797400] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.845907] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.846190] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.846190] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.846324] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.849570] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.849805] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.850500] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.850641] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.851422] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.851515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.856074] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.856264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.856951] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.857083] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.859131] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.859288] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.859971] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.860098] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.860978] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.861113] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.861843] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.861962] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.862573] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.862677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.863321] env[71140]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1354.863775] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.863860] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.866312] env[71140]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1354.866759] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.866866] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.868415] env[71140]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1354.868851] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.868955] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.872434] env[71140]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1354.872955] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.873152] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.874807] env[71140]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1354.875358] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.875551] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30d81b57-1e7d-4b6c-8223-18f586dd832a is going to be deleted. [ 1354.876550] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.876774] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.878406] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.878524] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.882407] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.882563] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.893455] env[71140]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1354.893974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.894151] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84ef6ff9-0b29-4536-8581-a65788a9e9d0 is going to be deleted. [ 1354.895119] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.895366] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.914945] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.915171] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aa19c80-0774-4c48-82b1-3685da8fb1c4 is going to be deleted. [ 1354.915975] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.916208] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.936158] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.936381] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc7015c2-a058-452d-bfd5-0575d4a237f8 is going to be deleted. [ 1354.937273] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.937531] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.941017] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.941195] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.954017] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.954253] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.964981] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.965184] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fe121ab-f6de-4059-bbdf-9b957346a3d3 is going to be deleted. [ 1354.966033] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.966256] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.009657] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.009836] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a008c941-3472-43c0-815f-ad4259496329 is going to be deleted. [ 1355.010748] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.010982] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.015377] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.015522] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.016573] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.016672] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.061064] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.061272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.069397] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.069600] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43a772d0-e00d-4627-ad2d-c6c3ccbcee06 is going to be deleted. [ 1355.070451] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.070677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.245712] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.245902] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 638f5992-652b-4deb-89c8-b409cb49bf0a is going to be deleted. [ 1355.246869] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.247139] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.309167] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.314258] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.314406] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.315760] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.315884] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4143c3a0-53e5-4025-8a89-c9d1e7dbb668 is going to be deleted. [ 1355.316766] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.316981] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.356557] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.356803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.373497] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.373720] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8bf2e04-ddcc-43f4-b665-59a628a61547 is going to be deleted. [ 1355.374608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.374823] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.421412] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.421637] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.422746] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.422900] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1516d35-770d-4ac2-bf00-b0eed6f837f7 is going to be deleted. [ 1355.424108] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.424372] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.471494] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.471673] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8623c530-dbd9-4cff-983a-f2df2ac9ad58 is going to be deleted. [ 1355.472525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.472771] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.492460] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.492752] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.523928] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.524199] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.554084] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.554321] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89ab7a19-079c-4b53-bee2-637fae5e2fc1 is going to be deleted. [ 1355.555171] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.555427] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.585681] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.585925] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.589576] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.589710] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c99ec8b-0259-4916-a240-54938fc5a81c is going to be deleted. [ 1355.590616] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.590835] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.609643] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.609908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.615255] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.615448] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42f38ff1-7afd-4b06-8a81-a4f009035e8b is going to be deleted. [ 1355.616268] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.616495] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.671908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.672072] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9372f7d-fcc5-4703-b77d-bbb4d1695328 is going to be deleted. [ 1355.673043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.673266] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.718932] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.719146] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.765664] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.765981] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.780429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.780643] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c549bd3-468a-4655-b709-3480ff374e11 is going to be deleted. [ 1355.781926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.782242] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.782429] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.782653] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30d81b57-1e7d-4b6c-8223-18f586dd832a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.783723] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.783908] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.783954] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.784220] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.784346] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.784522] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9372f7d-fcc5-4703-b77d-bbb4d1695328" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.784716] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.785060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.785060] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.785264] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84ef6ff9-0b29-4536-8581-a65788a9e9d0" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.785935] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.786188] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.786297] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.786520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc7015c2-a058-452d-bfd5-0575d4a237f8" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.786658] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.786871] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.787428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.787428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aa19c80-0774-4c48-82b1-3685da8fb1c4" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.787428] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.787721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.787721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.787825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fe121ab-f6de-4059-bbdf-9b957346a3d3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.787985] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.788216] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.788338] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.788536] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a008c941-3472-43c0-815f-ad4259496329" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.788677] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.788892] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.789015] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.789189] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43a772d0-e00d-4627-ad2d-c6c3ccbcee06" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.789375] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.789623] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.789698] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.789851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-638f5992-652b-4deb-89c8-b409cb49bf0a" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.790034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.790247] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.790368] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.790558] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4143c3a0-53e5-4025-8a89-c9d1e7dbb668" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.790700] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.790918] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.791343] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.791343] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8bf2e04-ddcc-43f4-b665-59a628a61547" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.791343] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.791596] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.791661] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.791832] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1516d35-770d-4ac2-bf00-b0eed6f837f7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.792034] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.792239] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.792351] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.792523] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8623c530-dbd9-4cff-983a-f2df2ac9ad58" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.792750] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.792899] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.793030] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.793217] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89ab7a19-079c-4b53-bee2-637fae5e2fc1" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.793386] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.793659] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.793775] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.793848] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c99ec8b-0259-4916-a240-54938fc5a81c" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.811422] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 893ec538-5364-452f-9431-cbce81e1231d: rpc.has_security_group_logging(os_id): False [ 1355.836493] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.836671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.836671] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.836926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.858629] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.858803] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.904750] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.904917] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.905932] env[71140]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1355.906479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.906740] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.906836] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.906919] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.907144] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.907230] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.907323] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 893ec538-5364-452f-9431-cbce81e1231d is going to be updated. [ 1355.908493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.908592] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.908682] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.908786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42f38ff1-7afd-4b06-8a81-a4f009035e8b" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.908867] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.909043] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.909104] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.909228] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c549bd3-468a-4655-b709-3480ff374e11" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.989936] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.990278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.990278] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.990432] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.990525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.020985] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 893ec538-5364-452f-9431-cbce81e1231d in Status: IN_PROGRESS for 2s [ 1358.035482] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 893ec538-5364-452f-9431-cbce81e1231d in Status: SUCCESS [ 1358.035847] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.264492] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1359.264832] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1364.266108] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.266574] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1364.586306] env[71140]: INFO networking_nsxv3.common.synchronization [req-63cf34eb-1549-49ed-a81e-6aa77ec35a0d req-c30eab44-6b15-49b0-8c25-7952cf9fdd79 tempest-ServerActionsTestOtherA-289074452 tempest-ServerActionsTestOtherA-289074452-project-member] Enqueued Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_members [ 1364.586839] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 893ec538-5364-452f-9431-cbce81e1231d with Priority: HIGHEST for action security_group_members [ 1364.587155] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-893ec538-5364-452f-9431-cbce81e1231d taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.587276] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.587342] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.587533] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.587686] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.587786] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.587841] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.587974] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.588209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.588318] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('893ec538-5364-452f-9431-cbce81e1231d',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.090566] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.090778] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.090829] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.091020] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.091114] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.091309] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.091409] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.091461] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.091608] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.091686] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.091771] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 893ec538-5364-452f-9431-cbce81e1231d is going to be updated. [ 1365.117939] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.118093] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.118136] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.118295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.118425] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.126443] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 893ec538-5364-452f-9431-cbce81e1231d in Status: IN_PROGRESS for 2s [ 1367.137445] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 893ec538-5364-452f-9431-cbce81e1231d in Status: SUCCESS [ 1367.137862] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 893ec538-5364-452f-9431-cbce81e1231d deletion is rescheduled due to dependency. [ 1367.137862] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-893ec538-5364-452f-9431-cbce81e1231d" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.587729] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1369.588021] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1372.172121] env[71140]: INFO networking_nsxv3.common.synchronization [None req-507feecf-d76b-4af8-ba7c-5090412ba91d None None] Enqueued Resource ID: db587888-7c23-428c-9fa8-7c1f7185cd44 with Priority: HIGHEST for action port [ 1372.172389] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db587888-7c23-428c-9fa8-7c1f7185cd44 with Priority: HIGHEST for action port [ 1372.173346] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-db587888-7c23-428c-9fa8-7c1f7185cd44 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.173512] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db587888-7c23-428c-9fa8-7c1f7185cd44" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.173761] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db587888-7c23-428c-9fa8-7c1f7185cd44" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.173825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db587888-7c23-428c-9fa8-7c1f7185cd44" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.173896] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db587888-7c23-428c-9fa8-7c1f7185cd44',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.678034] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db587888-7c23-428c-9fa8-7c1f7185cd44 [ 1372.678269] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.678404] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.678479] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.678694] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.678788] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.678890] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db587888-7c23-428c-9fa8-7c1f7185cd44 already deleted. [ 1372.678973] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db587888-7c23-428c-9fa8-7c1f7185cd44" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.321787] env[71140]: INFO networking_nsxv3.common.synchronization [None req-6023f783-e347-4f47-8ddc-210c4b5d9b6b None None] Enqueued Resource ID: 36a834bb-2633-462a-b091-4702bfcdc151 with Priority: HIGHEST for action port [ 1374.321787] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36a834bb-2633-462a-b091-4702bfcdc151 with Priority: HIGHEST for action port [ 1374.322182] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-36a834bb-2633-462a-b091-4702bfcdc151 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.322245] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36a834bb-2633-462a-b091-4702bfcdc151" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.322272] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36a834bb-2633-462a-b091-4702bfcdc151" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.322511] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36a834bb-2633-462a-b091-4702bfcdc151" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.322627] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36a834bb-2633-462a-b091-4702bfcdc151',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.824843] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36a834bb-2633-462a-b091-4702bfcdc151 [ 1374.824843] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.825044] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.825076] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.825353] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.825477] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.825604] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36a834bb-2633-462a-b091-4702bfcdc151 already deleted. [ 1374.825707] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36a834bb-2633-462a-b091-4702bfcdc151" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.353129] env[71140]: INFO networking_nsxv3.common.synchronization [req-f34d4e30-3cf4-47b3-8295-f7d18ed98cd5 req-15b40bd4-a1f2-424e-a7a0-f8229bb2cbcc tempest-ServerAddressesTestJSON-10888691 tempest-ServerAddressesTestJSON-10888691-project-member] Enqueued Resource ID: e565931d-6052-44cb-bbba-f7976467fa5f with Priority: HIGHEST for action security_group_members [ 1377.353702] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e565931d-6052-44cb-bbba-f7976467fa5f with Priority: HIGHEST for action security_group_members [ 1377.354118] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e565931d-6052-44cb-bbba-f7976467fa5f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.354220] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.354316] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.354545] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.355298] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.355667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.355667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.355667] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.355770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.355798] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e565931d-6052-44cb-bbba-f7976467fa5f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.599894] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock network-912 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.600147] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "network-912" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.600289] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "network-912" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.600621] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "network-912" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.600925] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.601104] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.601227] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.601472] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.601597] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.601809] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1377.601928] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] NeedRegenerationException {{(pid=71140) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1377.602050] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] no value, waiting for create lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1377.602164] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] value creation lock acquired {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1377.602274] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] No value present for key: 'zone-id' {{(pid=71140) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1377.602381] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Calling creation function for not-yet-present value {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1377.604057] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1377.621660] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1377.621861] env[71140]: DEBUG dogpile.cache.region [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=71140) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1377.622106] env[71140]: DEBUG dogpile.lock [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Released creation lock {{(pid=71140) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1377.622378] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "network-912" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.622837] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock port-8bdc1171-8448-463f-af97-87c6e3c62be3 taken with stack trace [, , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.623044] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "port-8bdc1171-8448-463f-af97-87c6e3c62be3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.623180] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "port-8bdc1171-8448-463f-af97-87c6e3c62be3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.623460] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "port-8bdc1171-8448-463f-af97-87c6e3c62be3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.623600] env[71140]: DEBUG networking_nsxv3.api.rpc [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bdc1171-8448-463f-af97-87c6e3c62be3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.859088] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.859088] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.859088] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.859088] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.859088] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.859088] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.859374] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.859374] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.859374] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.859374] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.859478] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e565931d-6052-44cb-bbba-f7976467fa5f already deleted. [ 1377.859518] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.126196] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.126408] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.126538] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.126809] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.126961] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.127134] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Segment Port 8bdc1171-8448-463f-af97-87c6e3c62be3 not found, creating... [ 1378.127395] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.127552] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.127675] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.127889] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.128046] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.128332] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.128489] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.128610] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.128815] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.128956] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.129112] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Resource: SegmentPort with ID: 8bdc1171-8448-463f-af97-87c6e3c62be3 is going to be created. [ 1378.146234] env[71140]: DEBUG networking_nsxv3.common.locking [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.146420] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.146537] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.146758] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.146976] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.147213] env[71140]: DEBUG oslo_concurrency.lockutils [None req-91d8e204-017e-4eb9-9548-b3119def0fa2 None None] Releasing lock "port-8bdc1171-8448-463f-af97-87c6e3c62be3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.821691] env[71140]: INFO networking_nsxv3.common.synchronization [req-f34d4e30-3cf4-47b3-8295-f7d18ed98cd5 req-58ee00b1-a9b3-4062-a419-15aa009ac8f4 service nova] Enqueued Resource ID: e565931d-6052-44cb-bbba-f7976467fa5f with Priority: HIGHEST for action security_group_rules [ 1378.821933] env[71140]: INFO networking_nsxv3.common.synchronization [req-f34d4e30-3cf4-47b3-8295-f7d18ed98cd5 req-58ee00b1-a9b3-4062-a419-15aa009ac8f4 service nova] Enqueued Resource ID: e565931d-6052-44cb-bbba-f7976467fa5f with Priority: HIGHEST for action security_group_members [ 1378.822020] env[71140]: INFO networking_nsxv3.common.synchronization [req-f34d4e30-3cf4-47b3-8295-f7d18ed98cd5 req-58ee00b1-a9b3-4062-a419-15aa009ac8f4 service nova] Enqueued Resource ID: 8bdc1171-8448-463f-af97-87c6e3c62be3 with Priority: HIGHEST for action port [ 1378.822247] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e565931d-6052-44cb-bbba-f7976467fa5f with Priority: HIGHEST for action security_group_rules [ 1378.822376] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e565931d-6052-44cb-bbba-f7976467fa5f with Priority: HIGHEST for action security_group_members [ 1378.822500] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bdc1171-8448-463f-af97-87c6e3c62be3 with Priority: HIGHEST for action port [ 1378.823053] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e565931d-6052-44cb-bbba-f7976467fa5f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.823182] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.823251] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.823501] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.823585] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e565931d-6052-44cb-bbba-f7976467fa5f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.824384] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e565931d-6052-44cb-bbba-f7976467fa5f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.824493] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.824562] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.824722] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.824871] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.824997] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.825076] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.825240] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.825325] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.825411] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e565931d-6052-44cb-bbba-f7976467fa5f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.826110] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bdc1171-8448-463f-af97-87c6e3c62be3 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.826217] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bdc1171-8448-463f-af97-87c6e3c62be3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.826281] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bdc1171-8448-463f-af97-87c6e3c62be3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.826431] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bdc1171-8448-463f-af97-87c6e3c62be3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.826505] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bdc1171-8448-463f-af97-87c6e3c62be3',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.328342] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e565931d-6052-44cb-bbba-f7976467fa5f taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.328502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.329785] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e565931d-6052-44cb-bbba-f7976467fa5f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.330701] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8bdc1171-8448-463f-af97-87c6e3c62be3 with status ACTIVE [ 1379.330969] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.331153] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.331252] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.331515] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.331615] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.331795] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.331893] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.331958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.332129] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.332206] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.332399] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.332525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.332525] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.332920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.332920] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.332920] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8bdc1171-8448-463f-af97-87c6e3c62be3 is going to be updated. [ 1379.352038] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.352180] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.352295] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.352418] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.352548] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.352708] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bdc1171-8448-463f-af97-87c6e3c62be3" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.835385] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e565931d-6052-44cb-bbba-f7976467fa5f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.338103] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.338298] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.338385] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.338590] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.338690] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.338800] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e565931d-6052-44cb-bbba-f7976467fa5f is going to be created. [ 1380.362343] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.362528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.362528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.362717] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.362926] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.371325] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e565931d-6052-44cb-bbba-f7976467fa5f in Status: UNINITIALIZED for 2s [ 1382.382079] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e565931d-6052-44cb-bbba-f7976467fa5f in Status: SUCCESS [ 1382.382079] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.382474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.382474] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.382589] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.382704] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.382770] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.382958] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.383052] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.383142] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.383236] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e565931d-6052-44cb-bbba-f7976467fa5f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.886209] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e565931d-6052-44cb-bbba-f7976467fa5f taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.886461] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.886600] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.886969] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.887288] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.887426] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.887546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.887857] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.888104] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.888286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.888580] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e565931d-6052-44cb-bbba-f7976467fa5f taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.888792] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.888932] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.889221] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.889472] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.889603] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.889673] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.889825] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.889924] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.890025] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.890128] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e565931d-6052-44cb-bbba-f7976467fa5f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.393615] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e565931d-6052-44cb-bbba-f7976467fa5f: rpc.has_security_group_logging(os_id): False [ 1383.410386] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.410535] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.410596] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.410858] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.410952] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.411166] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.411274] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.411340] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.411502] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.411579] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.411757] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.411851] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.411911] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.412072] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.412146] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.412389] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.412488] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.412551] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.412692] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.412768] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.412933] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e565931d-6052-44cb-bbba-f7976467fa5f is going to be created. [ 1383.467553] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.467685] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.467721] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.467894] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.468134] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.483379] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e565931d-6052-44cb-bbba-f7976467fa5f in Status: IN_PROGRESS for 2s [ 1383.823391] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.823550] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1385.495559] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e565931d-6052-44cb-bbba-f7976467fa5f in Status: SUCCESS [ 1385.495870] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.727444] env[71140]: INFO networking_nsxv3.common.synchronization [req-6a30eab3-4671-48d8-baec-429bfa00a27e req-59ce2b41-cca7-44ba-a522-4daa1a14d30c tempest-ServerAddressesTestJSON-10888691 tempest-ServerAddressesTestJSON-10888691-project-member] Enqueued Resource ID: e565931d-6052-44cb-bbba-f7976467fa5f with Priority: HIGHEST for action security_group_members [ 1388.728145] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e565931d-6052-44cb-bbba-f7976467fa5f with Priority: HIGHEST for action security_group_members [ 1388.728951] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-e565931d-6052-44cb-bbba-f7976467fa5f taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.728951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.728951] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.729078] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.729207] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.729286] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.729350] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.729546] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.729643] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.729745] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e565931d-6052-44cb-bbba-f7976467fa5f',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.232558] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.232748] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.232831] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.233107] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.233209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.233415] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.233522] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.233568] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.233718] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.233791] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.233876] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e565931d-6052-44cb-bbba-f7976467fa5f is going to be updated. [ 1389.261432] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.261611] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.261669] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.261834] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.261978] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.269813] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e565931d-6052-44cb-bbba-f7976467fa5f in Status: IN_PROGRESS for 2s [ 1391.280425] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e565931d-6052-44cb-bbba-f7976467fa5f in Status: SUCCESS [ 1391.280758] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e565931d-6052-44cb-bbba-f7976467fa5f deletion is rescheduled due to dependency. [ 1391.280758] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e565931d-6052-44cb-bbba-f7976467fa5f" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.728637] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1393.728974] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.729374] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1398.729650] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.880470] env[71140]: INFO networking_nsxv3.common.synchronization [req-12b5511c-6cd3-4ab8-80c8-0e83bd021005 req-9a16640a-b95b-4001-971e-fa1c1e68f94a tempest-ServerActionsTestJSON-2079743708 tempest-ServerActionsTestJSON-2079743708-project-member] Enqueued Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 1398.880750] env[71140]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e62d50e-c934-4166-825a-6649880de6a7 with Priority: HIGHEST for action security_group_members [ 1398.881076] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e62d50e-c934-4166-825a-6649880de6a7 taken with stack trace [, , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.881209] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.881300] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.881528] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.881683] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.881780] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.881843] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.882504] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.882504] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.882504] env[71140]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e62d50e-c934-4166-825a-6649880de6a7',) {} {{(pid=71140) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.384390] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.384539] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.384582] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.384790] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.406050] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.406284] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.406391] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.406463] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.406695] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.406784] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.406877] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 is going to be updated. [ 1399.434991] env[71140]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=71140) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.435156] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.435224] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.435394] env[71140]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.435520] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.442975] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: IN_PROGRESS for 2s [ 1401.453966] env[71140]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e62d50e-c934-4166-825a-6649880de6a7 in Status: SUCCESS [ 1401.454304] env[71140]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e62d50e-c934-4166-825a-6649880de6a7 deletion is rescheduled due to dependency. [ 1401.454304] env[71140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e62d50e-c934-4166-825a-6649880de6a7" {{(pid=71140) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.882128] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.882427] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1408.882986] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.883306] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.884390] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.884390] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.885057] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.885057] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.885987] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.886263] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.887255] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.887255] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.888421] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.888738] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.889326] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.889719] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1443.890346] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.890630] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.892021] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.892380] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.893458] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.893801] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.894514] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.894857] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1463.895844] env[71140]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1463.895844] env[71140]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0